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IMTROOUCTION 



What is' statewide program review? To whom is.it important? How 
does it' operate fn Cal ifarnia?. How. can it be iiiade m#e resjponsive 
tQ questions of quality and accountability?; These questioW, are 
'answered in the three 'parts of this report biased oR^j^ix-month'- 
study and^evaVuation of statewidW program review, proc-edures in 
California, . We focus- attention on -the r^^es, responsibilities, 
an'd activities of- the admini-strattve centra V off ices of four or- 
ganizations : (1) the California PostsecondarXEducation Com-r 
mission ("Convnission")', (2) the Ca1ifornia!^Gcfim!n4ty Colleges; . 
(3), the Cal iforn^ia .State Ui versity and^ CoV.leges, and (4) the . . 
University of California. The study was funSted by the Commission, 
and' this report is addressed to it- Our^findings arQ as criJiQal 
of Commission staff actijvity. perhaps more critical thai^ 



pf^ttie other organisations. The recommendations are, our own. 
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■'/ The report ha's three parts : • 



qV-'its 



^0 In Part I we define program review in the context *q 
critical relationships tq -academic planning,' examine cur 
rent literature and the experience in other "states, not? 
changiTjg sociarconditions, and describe the -govejning^ and 
coordinating mechanisms in' California,.* 



1. 



In Part 1 1", we present nine •recdmmendat ions for strength- 
ening state and segmental planning, for simplifying the 
review of new programs,^ and: for .'increasing acf ountg^bi 1 ity 
for jsducational objectives. V *' 
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■0. In Part' in, we emphasize the; interc(£tion of the recommenda- 
tions and their dependence on inkitutional program' pi ajimng 
a'nd program review. , ,. : ^ • ' ■ ■ A'.. 



This report had it^ genesis in our earlier reports/ on* the response! 
o-f-te'n Cal»iforn>a ipublic college and university campuses to enroll - < 
men t and financial stress (Bowen and- Glenny, '198Qj-, Glenny and A: 
Boweri; 1980)., In these' reports, we urged that individual campuses . 
'establish mgor^u^I-ajW^continiiing procedures for/ relating 'program ' 
of-^eringsJco enrollments, faculty staffing-, and /financial support. . 
We noted fihat -^'^tate and segrnarital jDolicies aref the .content in ; ^ . 



which inst\iutional;^freedom tTresp is found arid . 

inwhi^h pi ar^i^ng and program review procedures^ mu^ 
(Bowen ajd Glenny, 1980,. p..55[. Obvious quest,'i oris are impli^dr . 
; What are the state.and .segmental policies that provide the context 

i;or institutional resporis.fi to "stress?. Can these iioUcies and 
^the prjcedure^ derived from them address and. resplxf' i^sueT^f 
. statewide concern that will farise-ih the coming era of enVbllment 
and financial Itress? ° . / , . v; 

, to answer these questions, wp ha-ve examined state and secplental .• 
policies and procec^uresi/ an examination ^thsit has necessarily 
differeb brisider ably from our earl ier\i9i<ami^^ of/ institutional 
ones."' As diverse ;,as California's more thai) l^ p colleges 
and universities are as educatf-onal insti'tutighrs, tl^ir administrative 
procedures for planning and budgeting ar^f%haped by liiany pOmmon 
■ constrai nts : Students must- be regi stered,-: taught , and^ fed ; 
faculty must be recruited, promoted,/and pai'dr^^^sses must be 
scheduled to brin^^ faculty and sAdents together; budgetS^mu*st 
be developed, c|ef ended, and administered,; buildings- and grounds . 
must be maintained; parking pi aces' must be found, ^or everyone> . 
At"' the campus level, the options available to admimstrator?' 



foir addrjes sing these ORerati^nal i/ssues are limiied by real -stud- 
ents, real fatuity, and^tfie timing and sequence^ of real classes 
vand";programs; This real ity-not'^ only allowed the risk of general - 
-tzatlon amohg the campuses, districts; and_colleges but also 
..a>l owed (Consideration'' of a broad range of actiViti^es e-gr, 
'academic planning, personnel management,' budg^^ting. -enrollment 
projections, program revi-ew, facilities management, etc/ In sharp 
contrast^ reality is less intrusive and^manding at the state" "'^ 
and. segmental ^levels. ^ ^ . - ' ' * " ^ ! 

CThe segtental .central; offices and the Commission must, o:^coars?^:^ 

^deal witlT^real '^students'^ faculty, and programs, also, but^the 
tjif'eadth and nature of their responsibilities require issued ^ v:> 
be considered in aggregation across many irfstitutionsi^ Academic 

*pTanijing, program' review, bud^ting, person^iel , arid the whole 
range of ■ qdverning' and coordinating activities at state and seg-* > 

*mentaVleve1 vary far jnore ampng'the four state 'apd segmental 
organizations tfian dd the. institutionaUcounterp^rti of these 
acttyftles among^ the institutions: ,7 *^ ' . 



. 0 ' The^ segments a^e' three very large, hi'gfjl^ 

' izatibns each of which -differs from, the other two and from 
- ^ - the Commissi9n in qrganization, mission, -.anrl legal author7 
. ity: -Each of the three segment^^as a uHic^ue history that 
has "Shaped its relationships with, the institutions for which 
• it. is responsible. We wilVexploreCjthese differences at • 
greater length en Part I, / ' / • ^ 

■ ' > " ■ ' \ ■ ■ ^ ^- • 
' ' 0'' State and segmental staff organizatiq'n'for-planniRg, program 

reviewt^ and budgeting reflects not only substantive di/fer- 
. ences in size and mission but in management style as well, 

■ ' ' Relative freedom from immediate operational leonstr^aints 



. permits staff to be aligned and realigned. in each c'entral 
Qffice to reflect ehaaging policy emphase'^ and\interests. 

The enormous variations"!' n the'' organisation of Commiss\on staff 
arid the segmental * central offices, are to be expected- But t1ie 
great variations, however necessary and desirable they may" be, 
impose severe limitations on investigation. Description, anal- 
ysis, and evaluaiioji of aca^mic planning, program review, budget- 
ing, and other m|ijor state a^id segmental functions- would require ^ 
a new Master Plan, investigation.' But major state and segmental 
'policies can be reflected in examination ctf program, revi.ew, for, - 
as we show 'in Part tVprogram review is a window- from wHich one \ 
not onMy can, but must, view both ac^idemic planning and budget- '' , 
ing. This^onclusion, drWrKfi^om. oy" 1980 research (Bowen afid 
.GTenny; Glenny arid Bp^^^^^ directly to thi's eval uation .of . . 

program review fJrocediir.^s . ' 

'. ■ ■ " ■ ^ : . .. ■ - ' ■ 

this project began- i=n late September 1980. We_then squght the 
advice of segmental and Commissioa-^staff on study guide-lines and 
objectives. From each-organization, we requested and received 
a' description of current program review procedures that we re- . 
vised for brief inclusion in this reiDorf^CAppendiees A through 
D) . Field interview^ were conducted^ ;n Sacramento, Berkele'y, - ■ ■ 
and Long Beach, and we attended -two /meetings of the Interseg- 
mental Program Rej/iew Council .(iPRC), an advisory group to the 
Comm'is!rion. During the course of the project. We obtained both 
information and advice from knowledgeable persons .in o,th^ states. \ 

In January 1981, we circulated simmaries of majdr assumptions 
'and -tentative recommendations for review and 'cji^iticis^ to Com- 
mission, and segmental staff and to some -two do^en other reviewers/' 
(See Appendix -E). - The final recommendations -wgre devel oped. ' - 



>:duri|ig February and'^Mci^rch lDSl^^^^ Time prohibited, distribution ^ 
: of the ^l^rial'^reccflTimet^^ for additional; corniT^t fi%m those^ ^ 
interesieid in them. • • . '^ 

1 • • ■ ■ ^ • • ^ ^• 

• • • ■ ■■: -V 

• ■ ■ J » . ■ * ■ . ■ . ■ * - 

^his study. would not have been possible without the active coop- * 
I ^ ■ ♦ • ' ■ *, ^ ' 

.era t ion , of segmental and Commission officers ^d staff, W6 .partic- 

i^ularly thank Errfest Berg, Carlton Bovell , Norman Charles, and 

Antjiony^. Mdye for their time, advice*, patience, and candor, Wfe 

obtained va^ble *^inforrtiati on and insights from tpose who 'made 

time in.theijr busy schedules to comment on our^irt^^ 

atiohs'. . Otners contributed by sharing' our uncertainties w^ithl 

an^ administraitive meetings and seminars- None. . 

of thos^ wr^o. assisted us /wilVagrfee^lt^ all' of ttie reco|Tinendat1ons> 

and many will tlis agree s^'iiaVply^^ith some. Our. recommendations * ' 

are entirely vQur own, > v ' \- 



■J 



>Ep^P£eTiVEs ; 

At the risk of being bath tedious and overly didactic^ we^ must 
begin by defining our subject and placing it in tne. changing con- 
text of state and segmental governance and ^coordination. In the 
fir^t section below, we suggest tjiat program revjew must be defined 
in terms of its relationships to. academic planning and budgeting. 
In' the second, we explore the reasons for the growing importance 
(of program review. The third section provides the operational , 
context in California within'which program review' takes place. 

1. Program Revie'^?, Planning.; a>id ^udget^i n^ 

Review and' evaluation of instructional programs pervade academic 
life. Administrators and faculties at all colleges and universi- ' 
ties jn the United States spend\t1/ne collecting-and analyzing 
inforniation about instruction ---aboii^ what 4s taught to whom, 
who teaches it, and how much it costs. "Program review" encoih- 
4Dasses sucfi a wide diversity of activity that the term must tie 
more clearly defined before analysis is attempted* 

-. . ■ • . ^ 

. • ■ ■, . ' , ' o 

■■ ♦ " ■■ / (■■^■\ 

Sell (1980); suggests that there ar^e four components, in program / 
review-: (1) purposes, (2) organizational levei^ls, (3) mix of par- 
ticipants, and (4) .organizational context. All four are impor- ; 
tan't for 'our evaluation^^Ih general , we emphasize-the first two — - 
purposes and levels^of organization to define the limits and 
objectives^ of the study. The second two— - participants and organ- 
;izational context are used mainly for analysis and discussion 
of California's program review procedures in the "third section 
belQw. / . • . 



^Figure rdiagrams the three major organizational .l.ey,^-1s, of pro 
'gr'atp review in California against three primary uses'oV- purposes. 
Tlje figure is intended to emphasize: - ' ; ' - 

0 The primacy of the purpose of program', improvement .and qual- 
ity at the institutional level Cthe lower 'left of F'igure 1). 

0 The conmion purpose's of planning and program distribution 

at the' state and segmental J evels (the' upper right of Fig- 
• ure . e".. . 

Quality: The Primacy of Institutional Program Review 

We -speak of the "primacy" of institutional program review to as- • 
ure qual ity -because individual professors, and teachers make ttie < 
most critical decisions about instruction. in the classrooms, shbp§, 
and Uboratories. Individual instructors modify course pontent 
based on their perceptions of changes in the state of knowledge 
and in the needs of society and* of" their students.- In departments 
or divisions, instructors responsible 'for programs freely modify 
courses, course content, array of courses., and program require- . 
mi^E^ts based on their collective judgment, 
■■^f ' ■ ■ ■ '' . ' ' ' ■ 

The individual and collective decisions- within colleges, districts, 
and campuses are substantive and often far reaching.! , For most 
programs, these local reviews* evaluations, and resulting decisions 
provide the primary assurance of instructional qual ity — of the 
value of: higher education to students and to society. „ Local pro- 
gram review is highly disaggregated , highly personal , often infor- 
mal , and usually confidential. It is, moreover, '.the source of 
mosf major changes in higher edupati on. Such changes are only 
reviewed, if at all, after the fact. Ma^'or modifications of this' 
type are particuVarly chapcteristic of mature in^itutions such as 



FIGURE 1. USES/,PRIHARY PURPOSES/ AND ORGANIZATIONAL LEVELS 
OF INSTRUCTIONAL PROGRAM REVIEW IN*CALIFORNIA 
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most of :those in California: An' existing course is modified to 
accorranodate' a recent techno! ogi cai advance; " s new cpurse* i s acide'd' 
as the subject^ matter is expanded^ course? in 6"^ : - 

; are found relevant to -t-he expanded 'Subject? matter and the new:- • 
• .tfecfinology. Th?. new aggregation of courses atid their secj^ii^rice. 
have siiibstance and real ity ttf^instruttors. and students, but un- 
less the Institution \»&nts to have the aggregation and sequence" 
-formally recognized by a* new degree or certificate, neither state 
agency nor segmental program review procedures will. reach what ; 
may well Be an important and substaritive modif iciatibn ,of instruc- , 
tion. sConectiyely, over time, *Ehese incremental" reyiews and ■ 
V modificattpns %ua1T overwhelm the supposed importance of the- 

V review of individual ,* 'new program proposals for wJi;i;$^h mdst7:&f ' . 

V the internal and .external -structures and procedures for, prbgrarn* \ 
review are glared. ' - /. . " . v ■ ' ^ ■ ^.- ^^ 

^In *an earlier :repoi^ (BOwen and Glenny, 1980); we^iQrledMha^ 

stitutional program rev-iew be related to, and integrated^?\5^ 
V instruct! drial -planning arid budgeting. We .expanded in tha^^^^^^^^ 

on the importanee and. ur of, establ ish'i ng ongoings 
. -and processes to acpompl i sh this integration, RigDr(fl^|;0n| 

^ rev i ew of i nstrucfi bnal . programs i s es senti al at the . in^fef tut^^^ 
:s>; ' level ^because the value of every student 's^^^ducatltfft''a|p|^ ^; 

college and university is dependent oh it."" y . 

the autonomy of "individual in||tructors is 'conditionedby the 'organ- 
>i.zational and ^substantive contexts of :instructioh : (1) instruction 
in a course or. program is usually dependent on that in several 
others; (2) the offerings of one department may be dependent 
on thd^e of ahqthen^department; and (3)-f ini te institutional re- . 
sources must . be all o'cated ihternally. Fo rmal 1 y^ or informal ly,- 
intervention by administrators .and organized faculty groups Is / 




accepted at all colleges and universities as a necessary constr;aint 
^on prbgraRinatic change. _ _ / ' : , 

But institutions do not exist in a^acuuo]. As essential as local 

procedures are, they are necessari^^ limited by local concerns, ' ; 

informatton, and objectives/ StateV^nd segmental con^ns, pri- , 
^niarily about access, anrd^ economy, cross institutional boundaries. \ 

Local procedures^ are 'necessary* but hot .sufficient tn.^a .'state sup- 
■ ported systen\ of many colleges and univTfersitiesv^y ; V " ' .: 

Plannirig: The Reasons for Statewide Program Review . 

. _ ' \ • . ■ ■■ ,. ■■ ^- : ' : ' • ; 

The necessity of Intervention by "eiternal " agencies— a state 
•coordinating agency^ and multicampus central offices --is aot. 
readily accepted at institutions. But institutional as >vell as 
individual autonomy is conditioned by interdependence. - 

0 The programs of each college: and university mast be iconsis- 
tent with tM: mi ss.i on of tTO- segment to >jhiy:h it belongs, . 
and, in California-, segmental missions are defined and, dif^ 
ferentiated by statute. The state is entitled to assurance 
that each institution is performiTig a mission appropriate 
'to its segment and not performing those that are the prd- 
^ vi nee of another segment.; ^ / ^ " 

0 Several col%ges and universities usually draw students > 
> . i'rom 'the same geographical area, and many students have 
the^ option of ajttending any one of these. Many courses -t 
particularly in the lower division r- and many programs 
' will be offered by each institution. . Common sense and the 
V law suggest that some duplication may/ be unnecessary. Prp- 
• N , grammatically, low enrollnients, for example ^ usually mean 
that lewtr^^^ to suppoi^instruction. 




v., ■ ,. , x ' 

V But fiscally (and somewhat paradoxically), low enrollment 
. .will also mean higher unit costs- The state is entitled 
to justification of certain program duplication within re- 
gions among the several types CKf institutions*^ 

0 'Some:(academic and .occupational programs are highly special- 
* ".izgd and \appe'aT to a J imi ted, number of students Often ^ ' 
. . such . programs may be very cost3y/ The state '4 s entitled . < . 
/ _. to assurance of appropni ate di^strTbHtion of such programs • 
amorig'instUutipns Aft.d. across the stajtfe. , • ' ; ; ^ 

,: 6' Ihe state has ^als and obaecil,ves that can be reached ,on3yw 

' throughj:ooperative or consistent 'action on the' part of . 

. ' ■ -all or a substantial nu^ of instit.u,tions: student t|;ans-';l:. 

. ■ feV, affirmative action, remedial education., .pnd evenvtim'eTj^^^^^^^" 

• : and, accurate information .are example^ The state is, entitled!^ :. 

* ,' •> to assurance that its objectives are being 'pursued. ; : ^^^^^^^^^^^ 



-rvo j-he state has 'i'init^yresources to-distribute among colleges 

. • and universities, and -students have fllijte resourtes for . 
_ * .their educations. , Regardless- Of program content, the .state '. 
must, require that publ ic funds be equiiably distributed . 
and that questions of student access^and choice based -on 
private/financial status be cons ideretVfrOm a statewide.,. , '. 
perspective. ^ ■ 

We think that this" list Of reasons £o< state and' segmental inter- ^ 
vention into" institutional affairs is fairly exhaustive, for we V; ^ 
carefully suggest ..open-ended categories such .as "state" goals and f, 
objectives" and "resource allocation." We elaborate on this l.i.st 
in th& recormiendations in Part II because program review at the • : 
state and segmental, level s.j's art intervention Into-institutionaV^^^ ' 

autonomy that reqyir^* expr^^^^ C 




"Intervention" is a-^mewhat harsh Word that/often Reflects thef 
perspective of institiJtional ^dmNn^strators/and faculty/' The^ * [ 
view from the Gommission and the segnent^l/central offices would 
see "program^ review as one ^of the maijy functions, duties,- or facets 
of much broader governing and c€ordinatitig r^ponsibll ity. This 
view is reflected in FWure l;^in which/? 

■ . •'. * \ : ■ .V . ■ rr ' ■ •■ ■ ■ 

'. ' , --. ■ ■■ ■ . 

,■ V:0 the segments are shown as jjsing program revievi for "gover- 
r nahce^ind* coordination"' and for ithe purposes of planning:, 
program distrtjbutiori,' and b'tld^^ing. (A word of cautton: 1 
. \ ' Throughout thi<; r^port^ i t m/^t remembered- that the Board 



of Go\/ern'bl;i oi^ Ihe Califorr;i|a tornmunity.;fit5l leges is prf- 
mVily a "cQordina-frTsng board/|father than s^cj^vernlng one, ) 




J" 

0 . The 'Coimi5sion is shown a? using program review for coord- 
ination"- only, and for'the purposes 'of * statwide pl anning ^. 
and program distribution /among segments apd regions. 

The Commissrion ai^d the segmenliS .havfe;?quite different planning 
responsiblTities. The serpents engage .tn academic^plahning by 
projecting e^ollments and by assuring that their colleges and 
campuses have facilities, resources, and programs • to accommo-^ 
date their Students • T-he segmental central off ices have sub^ 
stantial authority to limit or modify the -programs that their 
institutions of f er 'and project in th&tr "academic plans • To. a 
greater , or lesser, extent, the segments- cohsolldate campus plans 
1n the develdpment of *a" segmental^ pTaji,,".-^ a pl an that may result 
in the segment's achieving more than the sum of the plans of;^its 
individual institutions.. Segm^entaT planning responsibility is- x 
reinfo»:ced by budgetary authority, the primary — although not 
the only — means through which governing*policjes are enforced. 




The Commission, on'^the other hand, ^ plans di rectly^f or neither^ ; 
the institutions nor the segments'! Us charge is to integrate . 
segmental plans — to aggregate them in an orderly fa-shi on. 
achieve ^tate olpjectives- Moreover, although tlie CommisSj|p^^ re- 
sponds to inquiries about segmental budget requests fi?om^the,ex^c- . 
utive and legislative branches,' it does not have iridepenfejrt budget 
responsibility, ^t the. state. 1?veV, therefore; program re>new - ' 
is for thW purpose of cols^dinatifin, aiti falls under the respon- . 
sibilittes of the state an^segmental offices for academit planning, 

-^.^ ■ • ^; ■ ; ' ■ ■• ^ 

^Ustate and segmental I.evels, *it ris coovenietit to^ivlde academic 
planning into "basic"'or lorig-rahge.J)lanTiing ^d "ongaing!* plan- ^ 

.fting^v /Statewide program review implements basic planning ami . 
is art intipgral part of ongoing planning. . ' * * . * . 

■ Basic. Planning . The academic plans of a segrjient or the state ^ ^ 
may 4De jfifuite specif ic /about^ the programs *that inViividud;!;!^^ 
tions may ot: may not offer; The California Master Plan-differ^<^. 
enti ates ; among segmental program of f erings . by 1 eyel s-of degrees . \ 
offered. Segmental plans or-policies restrict the pffering of 

^ degrees in specific disciplines (e.g. , agriculture or 
to particular cany uses v,^., Basic 'planning Hnntations and object ive^^^^^^ 
provide fundamental criteria for program? review i 

■ - ■ ' , " \- ■ ~" 

The California^^Master Plan's statutory provisions are. the- center- 
piece of basic planning, Ifor these establish the pKniciple of 
programmatic differentiation of funt^ion and the. strj ^Bxcg^ a^nd 
.responstbilities t)f the Commission/ This centerpiece is j)jr* 

. rounded by other and equally important state pol icies -~ e.g v5 . 

I ■ ■ ■ ■ ■ . 

agreements on differential eligibility criteria for student ad- 
missions; the Constitutional status of the Univ^sity of Cali-. 
foi^ia; student financial aidvstatutes and procedure^, etc.. Basic 
planning^ concerns' more than substantive .educational matters 



because much of the program rey lew activity of the Commission 
and the central office of the Commini^ Colleges is guided by; 
statute. To further compi icate understanding of basic pianning, 
state goals and objectives expressly and regularV/ appear in annual 
state budget and appropriations documents, and are undoubtedly ' 
implicit in state funding trends over the /y6arsr ^ 

. ■ •• ■ • ' ■ ■ ■• " . • ■' ' . ^ 

Basic planning policies and objectives are J ike Ty to be 'scattered 
among a wide v^ariety of sta.tuteSi, pol iciesv and informal/under- / ^. 
standing%4n every statek^and; for virtually a1 1 state governmentaTK. . 
endeavors, ^t appears Essential for the responsibile govern- 
mental agencies to bring order to fragmented pel icy at a level 
of general,! ty^ that ^permits development of operational objectives • 

We are aware of two recent attempts 'to drawv together state pol i cy 

■ ' ' ' ^ **' ■ ■ ■ . ' f 

fpr higher education into coherent ;statfiment$. . In 1974, a !legis- . 

• • •■ . - * . ■ 

lative resolution stated eleven statewide goal s v(State of Cali- 
fprnia, 1974), but we have be'feri unable to^l.pcate any later refer- 
ence to these'^ ^ome 31 "state goals'* were listed i^tb6 Com- 
mission's 197x6-8a Five-Year Pl^an- (Cailiforpia* Postsecondar^y Educa- 
tion Commission, '^1975, p^i- 12),f The. Statement dli not diff^^ . 
tiate between goals for the state arid goal a for'thfe Commission 
itself, and th^ latter \ appeared more numerous • .Neither statement 
Imposes priority order on the goals^.nor^doei^lt appear that either 
hasNhad any influence oa statewide program review/^ m ' ' 

It;! Issues irv- Planning- for^the Eighties^ "Commission' 3 taff recog- 
'nize the needs for '>g1 early defined statewide goals and objectives" 
(California Rostsecojidary Education Commissiori, 1980D',' p;' 113);^ 
but find the need mdriB easily recognized than met, As' an' agency 
,with advisory.authorj-^^^pnly, the Commis^^^ cannot oil^ts own 
formulate^tatewide- gdal^s^^ it can, however, col/lect the^presently 
scattered policies, giv¥^^^^^ order, and, in clise. fobperi^^^^^ 
with the segments^ ariiculate them so th^ they, will be of vuseV 
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We beiiev^ that such a statement is'^ssentlal in any attempt bo 

■ • . • ■ . ' ■ • . . ' ' 

evaluate Statewide program review procedures^ . • 

. ' • . ■ » ■ ■ . ■ . 

At the inception of this project, we cir^ut^ted W -brief |)rospectus 
that stated,- among other things, that we would 'ei/aluate ijtatewide"" 
program review procedures "by considering Hhe. priiiab-le useful-, 
ness of 'these procedures for meeting statewide needs " 
the doubt that 'one cr"Ttic expressed about our abil ity to 
"statewide needs," and have no illusions that we Mve thoroughly^ 
done so. But evaluation required that we make the. attempt. - Based 
primarily on Commission strfFt-l lssue^aper and on -the two earl ief- 
statements, we alsumed the folTowing^sta^e goals and priorities, 
solely, for purposes o^f this evaluation:. / * 




We shared 
identify V 



r. /diversity among segments/ insti tuitions ^ and progr^s; ; 

- 2. maximum student choice of programs and institutions" wit)iin .-^ 
available resources; . ' ': 

3. optimal 'li'se of state funds and other resources; - ■ : , 

•4/maintepanGe.pf patity options .for t^e future^ ' ' . . 

5. ijdentifi cation and response to- educalfTonal and societal v 

. ne^ds; and . , * - . . *. 

" ■ '-^v.^;-- ., . " " ■ ■ ■ ■ . ' ■ '. ■ " ^ . ■ . ■ ■ ■. 

6^^|lternatically developed new educational approaches and " 
/.deHvery systems.. ' • .■ ' ■• 

:'■ /■ ■•^m-i- ' ■ - ■ -I . ' -v ■ ■ .■ 

Ongoing Plahnfnk : Basic: state -and segipental goals and plans .may- 
prohibit speci;i^'c::'!jr^§rams, but they provide only the mast general , 
positive guidance on; what programs may- be offered. The range 
of possible offerings-f is usually restricted only by rather broadly 
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worded institutional mission "statements: A campus is character- 
izey as "developing" or "mature;" - as "urban" or "rural;." as "tecti- 
nical" or "liberaj^^arts." At some threshold of program content, 
exp^nsei* and'^ size, state and segmental authorities must ^assure^ 
themselves of tbe consistency of both tiew and existing programs 
with state and segmental plans and objectives and with parti cu- 
Taf* campus missions. In California^and elsewhere, this assurance 
i*s commonly' obtained^ as part of, ongoing planning at one or more^ 
of three stages in the development of a program^. Each Stage h^s ' ^ 
expl icit imp1 tcations ^f(fr "statewide prograim review procedures" 
as used in this report': ^ ' ^ . V , 

■ • ^ ■ . ' ' ' ■ 

a. Progected "Programs * State and* segmental planning procedures 
\ . may require Cas in\£alifornia)' that institutions annually,/. 
Tist or otherwise project the instructional programs pi a^ed^ 
for the next .several yearsl The 1(ngor with which state 
^ and segment^al authorities' review og even read these estimates 
varies considerably. <^t this earHest stage of determining 
^/^^ . institutianal expecta?io)ns, a projects^ program, may be no 
;h ^ more than a gleam in the- eye oif a single i^rsuaslve' profess^, 
amd 'at times, the need^ar a new program may ar;iser^b' quickly 
that an insti'tutionccannot project it two or^three years 
^ ^r\ advalhce. ' ^ '^'^'^^ ' ' 



\ 



.2. Proposed Programs . Altl^ough procedjures vary widi^ly across 
the states and muttic?un|*us systems^ most require rnstitu-" • 
tibns to submit detailed proposal s^-for^reviewv approval,- 
' or comment before the pi^bgram can be estapllshe^^ Proposals, 
aire usually required to be compreH^nsive|^Tn justifying the 
need for the program;, the ability of they nstitution to 
offer it, and the appropriateness of the p^ 
campus mission. Th^^ual if i cations of each faculty member 
who, will teach, for example, are often requiredTand an. 



entire profjosal nwiy run to over 100 pages. ^ /tn^lifoVm'a 
and. elsewhere, revie'W of tfTese detail ed progrjnjjroposals . 
" at the state ^nd segmental level s has been the primary mea'ns 
' of ^assurance that /the; institutional -offerings '?ire -consistent 
,« with state and segmental goals and plans. 



3.. Existing Programs .y Once a- iDrbgaam is establ i shgd and in 
■ operation, y4tat^"Vnd segm?nta>f off ices rarely audit its 
' success o/ei^feqtiveness.. Struct^ired segmental rev"l£w of 
* e'xi^tin/^Vograms is^rare'^ and such. review by a sta'te higher 
^. ■ edqccH^i on agency — afs i n New. York — is, • hi stdri cal 1 y , - 
rarer, still? (In the past five years, several regMlatory 
coord'iViatihg agencies have. -^een given this charge..) for . ^ 
' the most part, stalte- and segmental .otfi.ces rely, a's they 
jdo-in California, on indivWtlal itisAitutions to undertake ^ 
• such reviews, usually .assuringj:h^ internal .reviews ^are 
undertarlcen on a perijDdic trasts.*' :TKey only examine the same 
program' or di sci [31 i ne across 'i>r3s4:-6Eu.ti'ons w|iea a' cr i^ti cal ■ ^ 
need for' information or evaluatiDij arises. . Internal , instit^^ 
tiorjal. reviews, of existing programs ajje mofe'of less expl^^ 
- ■ in/ariWydr budgeta;ry processes! ;.T^^^ reviev/s may or 

.may hot be ;guicleci by planriii^^g expectations in addition to 
, , .)r budgetary necessities^. ' , 

A word must 'be said" about budgeting* Regardless of progra'm qual- 
^ itv or its conformance to an ihstitutionaT mission, a Tirogram 
i ^a.nnot and should not be established- or continued unless it- can 
b ^supported . by adequate facility And other resources.. UntiV.re-'- 
cently, enrollment growth automatically brought added resources 
- for new programs and for improvement of. existing ones.. At p.i«et4- 

sejnt, hbweveri, few institutions can anticipate additipnal . stu- 
: dents-, much less%dded funds for, new programs. -.Over, the next.. 
t?n or fifteen ^years, institutional^ segmental, and even state 



budgeting i^i 11 require careful attention to the distribution of 
^e^;ources among programs. This attention requires greater reli- 
ance on. planning and program review than in the past. Too often 
programmatic change (or lack of it) results from decisions made 
for fiscal reasons only. Although' program reviews'can be under- 
taken sjoley for budgetary purposes, they will lack primary focus 
■^n edu(cational objecti>^|., . Of greater value are ,th^se reviews 
that inform ongoing planh^T$"and, i.n turn; direct resource 
allocation, 



Our evaluation ^of prpcedwes-.that- reach projected programs, pro- 
posed jDrograms, '^ind existing/^^ies rel^^ on the concept 

•of program review founded in. Basic planning and conducted as part 
of ongoing. planning. We are welj' aware of the skepticism that . 
surrounds planning c^nd jts implementatiion. Despite this skepti- 
cism some of which, we" share -- state and\segmental governing 
and coordi halting bodies have responsibilities that can be exer- 

„ ci"sedv.bnly iD'yx intervention in the affairs of indivitfijal instttu- 
tiortS', ' If this. Intervention is^^^^^^^^^^ to be. ad hoc, arbitrary, and 
fragm^nted^ it must fae guided by reasona expl^icitv^riowledge • 
of the^programs that fhe iristltutioris^ offer and plan to offer, ^ 
In ^addftion, sta^te and segmental i program plans should be reason- 
ably e>^licit about the programs that particular institutions 
should offer and the criteria by which such- decisions are made,- 

: --^ \ ^ ' ^ 
Doubts about the. efficacy of plans and planners should itiform ■ 
fhe nature and extent of state 4nd:^segmental intervention, but 
these dcfubts should not pr^ent the necessary development of 
.ordered program e)^pectatipns that can only be called a "plan." 
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■ . 2. ^utstanti^g--Chanqe' arid Procedilral Stability : ^ . 

Two kinds -df. reviews of existing programs -^ake^lace:. An institu- . 
' titHi may examine one Or more' programs that it.offers, or a state V 
ageficy or multi campus syst^ may conduct statewide reviews — 
that is, the evaluation of similar^ programs; or disciplifies (e.g.,.' 
engineering, education, history) across all or most institutions 
in the state. Botft are as critical to academic pi ag^fting "as the 
•• evaluation of new" program .proposals or projections.^ But .statewide 
or' segmentwide review of existing programs .has not been of high 
priority until recently. ' Th.6 reasorft for the emerging ifhportance« 
^of this type; of "prbgram, review and some ^perierfces in oth^r states 
' are re^evairit to evaluation in Caf] ifornia:- . ' ■ .* / 

*" • • • ' 

V , . ■. -» . " , ^ . 

. ■. ■ ' ■ ' ; ■ i. ■•, . 

In a' 'short paper on, the .history of program^yiew, Harcferoad ^ 
• (1980, P.. .1?) states th'^t ' Academic prograH^jj^l uati on, ' as a . . 

> specialized term, arrived only recently in the jargon of» higher 
education .' " ' Before, about. 1975 , segmental, or ;$tateWi de review 

•. of particular program types was almost dtw^ys^nart of broad. dis- 
cussions Of -statewide or multicampifs' governance^nd coordination,, 
usually aminos part (See GTenny and HursV 197,1; llee and Boweh, . 

. 1971): ' Mqre recently, botfe^iiistitutional::^^ 

review has received ihcrei^fng attention iri scholarly publ ickions 
and. in administrative prat'tice. . But past negl ect is understarfdable; 



' : 0 . Planning was subordinate to budgetjing during the period^ ^ 
^ of grbwt a'subordination that unfortunately continues .. ,- 
in many cas^. Program review was pi;id remains moreV closely 
" related to planning -than to budget^^ 
K procedures have kept i t from s^ari ng budgeting ! s hi gher 

■ ■ ■ priorities.... - ' \ 



0* Program review is usually performed' at state or segmen't^al ; 

levels, by administrators whose' primary responsibilities- . ' 
. are elsewhere. Neither institutional nor state agency pro- • 

gram Vevlewers have the support of organized groups:^ The.^ev 
- is no professional association for program reviewers such 

as the. National Association of College ^and University Btisiness 

Officers (NACUBO)- or the Society for College and University 



.PlanningV(SCUP). . - \_ 

Prograin review's subordination "do budgeting and planning will ^ 
continue, witl?' separate professional org'aniza^tions "o»v career lad- 
ders unlikeily to appear for program reviewers. On the- other hand, 
there remains a third re9Son for low priority of program review,^ 
one that is changing: Xhis reason is the need for program evaluation 
in a period of enrol Intent and fiscal stress. \ \ 

When student and resources w^e more, plentiful than likejy 'in 
the next decade, program review was not very important to either 
administrative or faculty leaders, especiall^^ not segmental^ or 
statewide program revfevy. Controversy and interest arose from 
time to time over an 'institutitin's aspirations to ofi^er a new 
program, but most often ?tvailatffe funds could support faculty 
initiative without disturbing funds for existing programs.. When 
it became apparent that funds and students 'could become scarce, 
the possibilities of retrenchment, consolidation, and termination 
began to be '<liscussed: A task force of .the Educcttion Commission 
of ihe States raised the issue in 1973 (p/ 51) : - ^ 

"With expanding enrollments in higher education in the'decade-^ 
of the '60s, the process of discontinuing programs in higher 
.... education at the statewide tevBl occurred rarely, if -at all. 



But new enrpHment projections clearly suggest the possi- 
bility in the future of .considerable consolidation, reorgani- * 

zation, and curtailment. . '\- v. . * 

■ • . ■ ' ■ ' ' * - = ' ^ ■ *. ■ . 

The 1973 task force went on ta suggest that although new prc^ram 
proposals' can be judged on how they "fit the mission of the partic- 
ular institution and its constitutency, there must be a different 
basis for phasing out \)r reorganiztpg existing programs" (p^ 51, • ^ 
emphasis added)/ The.task-fqrce- listed ten 'Vacto^^ bfe consid-, 
ered in. phasing out or reorgariizing programs, and Barak 
•arrd Berdahl (1978^ pp. 68-74) surveyed the incidence of the use 
of these factors in % nationwide survey, r 

" ^ •.• ■ •• ■ • ■ ' ... ' ■ . ■• • ' ' "■ ■ 

In 1980j the Education Cotmiissi on of the States examined approaches 
to the review Of new programs jdtfring the coming decade, and ex- 
panded on its Earlier discussion of the emerging 'importance of 
the review of existing programs (p. 47):' 

"During the growth of higher education in the 1950s^and r960s5 
states had a strong interest in deciding where new instituti^ons 
were to be built and what programs they Were to offer. Although 
judgments were made^with consideration .for demand, for improve- 
;ment of stude,nt access, for financing and for governance, pol it- 
Ical expansionism and economic arguments often, superseded these 
educational concerns. One result of this unplanned ^expansion 
is that a number of states find themselves with a legacy of 
1;oo many institutions in the wrong place c^nd wU^ ^ 
.. programs. Because these problems Will exacerbate as enrol 1- 
ments decline, state prcJgram review will focus more on exist- 
ing programs during the 198Gs,." ' ' \ 

The implicati^Dns of enrollment projections for state and segmental 
planning and for program review remain as ominous now as in 1973: 



• 0 The ^.impact^*of statewide enrollment decline is distributed 

unevenly among institutions and amona programs within insti- 
tytions'* At many, campuses, some programs finjd.it difficult ^ 
"■ , ' to 'aHract sufficient students to. justify. their dperational 

• \ costs- Nv- ^ . * \ ^ ■ : 

■ ' . ' ^ ^ ' ' ■'■ ' ' 

0 State funding, continues to be based genera]li^>on enrollment A 
. -numbers. With fewer students and state funding declines, 
'institutions find it increasingly difficult to fund new 
"programs or to improve existing ones without shifting resources 
.^way from others. 

0 Competition for students increases: programs compete within . 
institutions; institutions compete within each public seg- 
' ' ment and across segments; the public sector competes with 
the independent sector. The obvious danger is that competi- 
tion may" take the form of reduction of program quality br . 
changei of institutional mission merely to maintain numbers. . 

The implications of . statew'1de..gi^nrollment;declin^ clearly give 
rise to the recent, interest' in program review.— particulairly . 
of existing programs. As first one campus and then apother find 
it difficult to enroll the number of. jl^u'dents expected, the' impli- 
cations of enrollment stability or/djBcTiHrie simply cannot be ignored.. 
But demographic changes have not been the only ones, to raise^ planning 
issues that program -review might address. Others iare relevant: 

• 0 Most coordinating agencies were established to. assure ^lorderly 

< ■" •■ ■ 

.« growth." Charged with preventing "unnecessary duplication," 

some established procedures ^r reviewing new program pro- 

posals before a planning context- had been developed;' and 

/ did so because of state governmental, concern. over uneconomic 

• - proliferation of programs aiid courses.. It is not: .accidental^ 



that 1t^war~the Cal if or'nia legisl ature, not the i ostitu- .. 
tipnil advisory Li ai son Committee , that interposed' the re- 
quiimeht of^S^te' higher on the 

iabTishment of new campuses (Berdahl , 1971, p. 142) . With 
rpl ati veTv'-mi r\Qt excetitixins. uneconomi c proli feration is 
no long'enan ifisue.-^^ The^ ^iiucational implications of program 
duplication remMn. , - . , .... ' ', ' 



Cbordinating agencies were established at a time. when new 
campu?€r>^reT«ingl3^nded ^a^ an. unprecedented rate. The 
st^k-b ' s 1 riteres t in a.ssari.rtg that the ini ti al-, steps taken • 

new administrators and new faculties at new locations 
were appropriate was larg.ely a responsibil ity of governing 
boards — in". California, the governing boards of the Uni- _ ^ 
vers.ity of California and the (then)_Ca,lifornia State Colleges 
• and a variety: of district boards for the- (.l:henf junior colleges 
» The state higher education agency also had a role in its 
advisory responsibility to comment oh new program proposal s. 
Now colleges and universities arej for the most part, mature 
instituttohs. G&verning rand coordinating procedures should,, 
.,be respoftsive to' the maturation of the campuses and colleges. 

^■Tlie two-year: 90llegd^^ the United States are nO longer 
^^i^h as a pVima for sorting and selecting students 

;for conti nuatiorr in fourrye^r;;^ (Riesman,:: 1980 , v , 

,184-191) . 'Most are now distinctly/4hdependent institutions - 
.with missions and constituencies of their. own.' Even greater ; 
indeperidence from the traditional bounds of higher education 
in remedial,, avocatipnal. andrcommunil^y education is being 
. urged across the 1 and ; The questi on tof whether two-year 
.colleges should .engage ,in activities not hi storical IV "col - 
. TegVate" cannot be answered here.' The question of whether 



: a state higher education agency. should attempt to evaluate 
such activities iinder procedures designed for "colTegiateil? 
offerings is clearly presented, ' / 

0. Across all sociaL and economic levels,, the scholastic pre- 
: paratiqn of prospective students for higher education has 
declfned. The day is long past when, ill-prepared students 
. mightj.be dismissed as "individuals who lack the capacity 
or thp will to succeed in their* studies" (California State 
. # Department of Educatio.n, 1960, p, 66)/ * 

Other changes over the past 15 or 20 j^ears are equally cri^tical : 
[ tncfeajsing concern with equal opportunity through affirmative 
action' for ethnic minorities and women; increasing federal interest 
through entitlement programs in stude)3t-f:^nancial a technological 
adya^nces. in information collectibn and its uses; and concern , 
for consumer protection, , . . 

Sep'arately and in cooperation, 'institutions," segments, and state 
higher education agencies in Galifornia and elsewhere have responded 
ta most. of these changes. For all of their reputed conservatism, 
higher education institutions have been remarkably responsive 
to the demands for social change. There is :ho reason to believe 
that needs; and demands for response to change will be less in 
the next decade. But d^lihing ejirotlments and. fiscal stringency 
are likely to engender, a "fortress mentality" that will resist . 
change. In puif* present context,' the question is whether pi anrrji 
and statewide program.reyiew' will or should have a >igni: 
role ir) enhancing the possibil Hi essnof successful response to 
change. ^ ' - ^ - 

Program review receivers substantially more attention than in the 
.^MSt, iDut both the descriptive arid the analytic literature is 




V, - , ■ ■ ■ .25 



r 



more relevant to t'his report ^ a source of general concepts than 
as one o.f specific sugg^tions. : At the .analytic level, writers 
focus on either institutional iprogram review "or on that by state 
higher education agencies; the roles and functions of multicampus 
segments are barely mentioned. 



The major work iri this aisea is Dressel's Handbook on. Academic • • 

Evaluation (1976), and it is undoubtedly of ,, great value'to insti-- . 
tutiOnal planners and. program reviewers. But it recognizes the 
existence of multicampus segments in only one sentence (p. 434) — . 
yet .in<197&, for example, we found that less than 20 percent of 
the institutional members of the National Association of State 
Universities and Land-Grant Colleges (NASULGC) were governed by 
a separate boardV over 80 percent were part of mul ticampus systems. 
In discussion of evaluation of state higher education agencies, 
he does not consider the differences between single, statewide 
governing boards and coordinating agencies to be .of "great signifi- 
cance'! (p. 436). Dressel's 'discussion is valuable — if Somewhat 
one-sided — in Retailing the adverse impacts t)iat statewide or 
segmental program planning and review can have ;on individual campuses. 

More directly related to progr?|m review at the jstate and segmental 
.levels, a perceptive article by Dofiald Smith states .-yiree primary 
functions for such reviews (1980, p. 45): | 

1. ^stablishing a context within which effective in^ftutional 

processes of program evaluation are at once encouraged, 

facilitated, and made necessary; , - 

2. conducting; certain mylti-institutional program evaluations • 
.for purposes, reflecting stftewide ratheH than institution- 

'■^ispecJjffic problems or concerns; 
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-^. protecting / insofar as possible, the primary resppnsibil- 
■ ities of the faculties from interveritionsV% agencies: exr , 
ternal to.or disassociated from the academic community into 
the work af judging academic ^program quality or need. 

The^first two functions stated*^ are i ndeed primary ones; We are 
somewhat dubious about the thirdT Assuredly state executive arid ' 
legislative fiscal agencies (and these are Smith- s. concern) should 
avoid intrusion into matters of academic jud^gment. Our experience 
indicates that such iritrusioa is rare in^ituations in which the > 
first two functions are performed. - Protection of academic pre- 
rogatives is a benefit of statewide prbgramrplanning and review, 
not a purpose that can 1)6 pursued or achieved in their absence. 
Accountability for educational objectives cannot be s^ 
from the processes which assure program quality at the. institutional 
level . ^ 

Smith, as does Dressel,>ecdgnizes the difference between a! single 
state governing board for all , public institutions in a state; and . 
"boards of stat^level cpordinating commissions." But other tha^ 
suggesting that there is "consjder^blie convef'gence" between- the 
two types' of agencies (p. 43) does. not further . consider the dif- 
ferences.-^ Interestingly, Smithes article is titled "Multi-Campus 
"System Approaches to Academic Program Evaluation," and is con- 
cerned with the roles of., single state governing boards, hot multi- 
campus isegments such^^as the University of California and the Cali- 
fornia State University and Colleges. 

We find little literature on the relationships among the three 
.levels of program review: institutional , segmental , and"'state 
agency. . The Education Commission of tfje States mentions that ^ 
program review "in many states is complicated by the existence 
of segmental systems that also engage in program review. . ." and 



* only urges that "coordin^ition amcyng all three levels is esSent1,aT' 
(1980, p. 51). • 'Aside from a brief. descriptive article about coor- 

'^dination in minois (Groves. 19791, Millett's earlier comment 
on the state of kifowledge about relationships between muUi^iampus , 
segments and s1;jtte higher education agencies' remains true today • 

- (1975, p. 62): < / 

"Although there has been one'majof study of the multi campus 
' university (Leef and Bowen, 1971),. and although there are two : 
• important studies of state coordinating and governing boards 
of higher educatian-(Glenny, 1959, and Berdahl , 1971), there 
.. . are no comparative studies of the three different kinds of ' 
structures. -Undoubtedly varying circumstances, varying history, 
and varying personaJi ties have had much to do- with the particular 
arrangemerits~ithat exist in any particular state. In-the absence 
of any careful empirical analysis of comparison or contrast, 
one must fall back upon experience and observation in order 
to comment about these, different arrajigements," 

Experience and observation* can b^ supplemented by tha approaches 
ysed by others to similar problems. An examination of program 
revievt. procedures in other states can be informative, but these 
procedures must be viewed in the context of enormous diversity 
in state organization, governance, and coordination of higher 
. edui^tion. • ; ' . • 

* We bring to^^^s present evaluation extensive. experience with 
state-levelip|rdination and governance, with multicamp'us gover- 
nance, and;(-||of at least equal importance — our l979-80^exam- 

■ '■ i nation of response of individual ihstUutions iii Gaiifornia 
J to enrollthe^t and financial stress. 

J 31 . 
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A national survey 'of state-level program review activities was 
"undertaken by Barak (197§;:-updated/1979 and\these ac^iv.ities : 
.^re analyzed by Barak and Berdahl (1978). Their studies are r 
siimmarfzed in the report of a WICHE-NCi\EMS workshop on Postsec- \ 
ondary - Educati on,. Pro<^ranr Review (1980), and would appear to form 
the basii for recommendations tn this area in the recent report 
on state-level -coordination and governance of the Education Com- 
nfii§sion of the States il980). . A collection of commissioned ar- 
' t'icles, of which the Donald Smfth paper is one^ is entitled Academic 
Program Evaluation (Craven, Ed., 1980), and is particularly useful 
,in presentfng^tbth institutional and- state^,^^ 'practices. 

■ •• ■ ^ - ' ■ .■■■r:^y^;"':- _ ; : ' .... \ . ■: ■■>[ ■ ■ , . ■ ■ ' 

Some findings from Other State- sttjdiesv^^^. . :^ 

0 The number of statewide or intersegmental progrsun reviews 
should be kept small and be clearly focused on ^particulars 
statewide issues to avoid duplication of institutional re\/iews 

0 Program reviews are not likely to turn up great budgetary , 
savings, but serve to achieve programmatic change, qualita-^ 
tive improvement, and the orderly planninig and developments . 
of new. programs and options. Pruning of weak programs is 
considered consistent with positive planning objectives. 

0 Each level of administration has a different and valid per- 
spective on program review; The purpose at individual insti- 
tutions is to maintain the quality and currency of programs 
and to facilitate the coordinated development of new program 
alternatives within existing resources. Although less pre- 
cisely defined, the role of segmental governing boards is 

to control the modification ordeletion of existing pro- 

.... -.^ . , ■ * . 

grams for the purposes of facilitating the strengthening 
/ of other programs or the establishing of new ones. 
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^5^5;^ Placing -all, rnsM^^^^ 
" structures- under a statewide umbrella increases, the legitimacy 

, \ of these* epQrt^^ of out:«de observers. 

.0 ; ^equiriag^ ^nsfttutior^s to pro)^^ jpbtice of intent 

to .pi &n . for a new program can avoid unnecessary prepar- 
.* ation of detailed proposals and can focus those that are 
prepared on state or segmental concerns. 

0 Joints reviews by multi campus central offices artd instftutions 
of recently established programs fill a gap in historical 
/program revi'eW; procedures. . : 

0 Aiprogram "audit" is an examination of a program in terms 
of a limited number of readily quantifiable indicators in- 
tended to bring problem areas to the surface". At the^ insti- 
tutional level , audits may suggest the timing of .ongoing 

/-reviews as an alternative to conducting these on routine, 

; / five-year cycles. ' 

■ . ■ ■ ■ . • ' ' ■» 

0 Brogram review's, as oppo^d to. program, audits, lead to rec- 
' ormendations on progrsun change. Institutions have the primary 
/ responsbilitv for reviews, but these may be conducted. by 
* segmental central offices or state coordinating agencies 
where similar programs?. across campuses raise questions of 
possible duplication,; program capacity, or where such prob- 
lems might arisp from development of new programs. 

The current heightened interest in statewide and segmental^ re^l^ews. 
■of existing pro'grams is clearly attributable to expectations of 
enrollfnent decline anci fiscal* stringency. .This relationship is 
unfortunate, for establishment or, modification 6f review procedures 
under present conditions is suspect as a "retrenchment" device. 



not, as should, be the case, "as an irfteg|*aT part of institutional 
mid-range artd long-range :planning, rather than a -crisis reaction ' 
to fiscal stringency" (Smithy D.K., 1975, pp, 9-10), The most 
sophisticated review procedures are of little use unless Jthose 
at the campuses — particularly the faculties — internalize their 
r^'sponsibili.ty for continuous reexamination of program quality, 

V ' '3; The California Context ^ . 

The findings and recommendations in Part II require an under-'^ 
standing of the major and critical differences among the govern ingff^v. 
and coordinating organizations in California, The California ' . 
Postsecondary Education Commission (Conmission), with responsibil- 
.ities that' comprehend the activities of -the three pufci^lic segments 
is first discussed, followed by examination of segmental differences 

The Commissnonr Advice and Consultation . ^ 

The responsibilities of the Commission comprehend not only the 
activities of the three public segments ,^'but, for example, extend 
to the independent sector, to student financial aid, and to admin- . 
i strati on af federal programs. To understand its role in Cali- 
fornia, comparison and contrast with higher education agencies 
in other states, rather than with the California segmental organ- 
izations, is desirable. Of the three usual^cate^ories of state 

Zhi,9:hec. education agencies, the Commission is in that considered 

^"tHe^;:w4etkest:" 

'o California's Commission is an advisory coordinating agency * 
It can give advice in narrowly defined areas— as in the 
establishment of new programs, btit, no one is required to 
follow that a^dvice. It is charged with integrating seg- 
. ' 'mental plans, but not with planning for the segments. It 




ca'fi offer, advice on budgets only when otbei^xecfftTv^ 
. legislative agencijsjs^ l3 states have ad- ^ 

___j«-sery'Tcoordinating agenci 

0 Stronger coordinatioir is found in about 18 states that rely 
on regulatory coordinating agencies that may-.have specific 
statutory 'authority oyer: budgets; plaTining_, a/cademic fetan- 
dards,, facilities, and othe>^matters. The Mencies i\ : 
Illinois, Maryland, and Tennessee are examples of such agen- 
cies! 



o Potentially, the strongest form of coordination is represented 
by^a single consolidated governing board that both governs 
and coordinates all four-year institutions in a state. The 
University of Wisconsiif'System has such a board, a'nd^its 
^ controls over new and existing programs are limited only 
by educational '-^snd policy considerations. There are some , 
16 boards of thiS' type. , : ~ ■ ^ . :^ ; v . ^ 



In an earl ier : study of state-1 evel 'f i seal stri ngency , we founds 
that state budget offices were'far more likely to rely on single , 
governing boards and regulatory coordinating agefttfies:in-the distri- 
bution of programs and resour^ces during fiscal stringency than 
cm advisbry agencies (Bowen and Glenny, 197&, p. 13) . On the 
other hand', the value of fornial authority in a period of fiscal . 
stress may be overstated. Formal authority allows "if board 'to 
shift funds' among institutions, to terminate programs, or to prohibit 
the initiation. of new ones. Sudh authority allows this imB^diatfr^^^ 
response to fiscal stringency, but often the difficu^lt decisions^ ,„ 
are delayed until a severe crisis develops. Long-range pUns 
and.impl'ementing procedures may not be in place. 'Overtime; copsis- 
; tent responses under plans provide at least as much cr^ibiHty - 
to an agency as does formal authority ( Berdahl , 197.5, "ppr-^- 5) . 



An advisory coordinating agency,, such as the California Commission, 
acquires ini'luence with state executivefl^and legislative agencies, 
. if at all, only "through the\quality and percepti veness of its 
studies and rfecoimiendations. To be effective, however, the Com- . . 
mission must hav§ credibility also with the segmental central 
.offices and the institution's. Such credibility depends not only 
on the quality of it? work but also on the perceived competafibe 
of .Commission staff and on their skills in negotiation, and per-* 
suasion. 

During the first..l5 years of coordination in California, the state 

higher education agency (the Coordinating Council on Higher Educa- . 

' ■ . • ■ ' . • ■ ■ - . , (J 

tion— CCHE) had Tittle credibility with either state agencies 
or the segments. The reasons have been explored by others (Palola, 

; et al ., 1970; and particularly Smelser, 1974, p. 123) , and, we 
need not repeat them here. What is important for the present . 
study is the increasing credibility of the successor; Comrnission: 

ri^s advice was sought when s'^tg fi seal agencies implemented Prop- 
osition 13 and, when they consTO possible passage of tlie 

■ revenue limiting initiative, .Proposition 9, in early i980; its 

^research reports restch current,\emerging, and/consequential issues - 
e.g., the impact of dlfferentialViUi^ access, off-campus . 

instruction, changing patterrts'bf articulation, etc. For reasons 
examined, later, the Commission's role in the review of new and . 
existing progranis has not shared in, whgt we perceive as the grgw- 
-Ing prestige, credibility, and ihfjjuente of r^e Commission.; 

.. . ^1 - " . • ■■ ■ 

Segmental Diversity: Plann 




The 1960 Master Plan for California higher education, whether 
considered as a "plan" or a "treaty", (See. Pal ^ et. al., 1970, 
pp. 164-170), clearly mandated, specific differences across the. 
segments that were to continue indefinitely. PI anned^^_§tatutory 



differentiation of function is the most visible aspect of -seg- . 
mental diversity^ bu$ it has- imp licatib^^^ program, review that 
gire less, VTsiblev Other factors— planned and perhaps unin- 
:tended — have equally important influence on statewide program 
. review ^prdcedliresy • ' • 



. r 



Planned Diversity . The two most critical aspects of the Cal iforhia 
Master Plan are: (1) differentiation of function among the three 
public segments and (2) differentiation of el igibility standards v 

for admission of students/ ' " ^ 

. . ' . ■ ' ■ • * '•. 

Pi f f erenti atiTpn- of Functi on . The Master Plan allocates 
responsibility for basic research, doctoral programs, arid-^ pro- 
fessional programs such as law and medicine to the University 
of Galifbrnia. The State' University and Colleges share respon- 
sibility for undergraduate educatioti and graduate education through 
.the master's degree, with the University of California, but can 
offer doctoral programs only jointly with it or with independent 
institutions.. The Community Colleges have responsibility for., 
lower division academic programs/ for occupational and Vocational 
progranjs titat do no lead to an associate degree, and^for- serv^e; 

to • 1 ocal dtJmmUni ti es . 

■ ^. t ■ . . ■ • * , . ■ ^ ■ . . 

■ ■ . .' ■ ■ . : . . ■ 

An important result of differentiation of function has been' an 
"automatic" distribution of most programs by degree level. . Nerth^f 
CCHE nor the Cortimission has had to face the'pro'Iiferatipn of pro- ,^ 
grams that in other states has required extensive apd'scontrover^-ial 
reviews of existing offerings (Louis-iana. and New York, for example; 
see Mingle, ;J978, pp. 60-64)". Monitoring adherence to prescribed 
diVferentiatibn: of function, largely through review of new programs, 
j^OTains a majiDr responsibility of the Commission. ■ . .. 



; ' Differentiatibh of EligifaiTity Standards . Under Master 
Plan policy, eligibility .to attend the Uni^^ersity of California 
i^ limited^ to the upper 12i percent of California's high school 
graduates. The? State University and Colleges can draw entering 
freshmen^ from the upper one-third of h«|^ school graduates, and 



all California citizens- over the age or^ra living in a district 

% - • • ■ ■ ' . . 

may attend a Ideal Community College^ " 

: • --^ : ' J.'.:': ' . .■.-■■s-.' / .• ; 

The differential eligibility standards, Iven as they have Wen 
relaxed by exceptions over the years, were-and are more exacting ' 
as a matter o-fc state policy than those Tn^qfher states. The high 
selectivity for the two four-year segments was justified in /few 
of the" authors of the Master Plan "because the junior colleges 
relieve them of the burden of doing remedial work" (C.aliforiiia 
State Department of Education, 196P', p. 66). To deal with pro- 
spective "numbers" as well as "quality," the authors' of the Master 
Plan also recommended that even eligible lower division applicants 
be diverted from the four^-year segments to the Gomrfiunity Colleges: 
The ratio of Tower division to upper division undergraduates in 
the four-year segments was to be reduced to, ^and maintained at, 
60/40 (p. 59). Thus, a number of high school graduates would 
be required to enter a community college although*their ultimate';:/ 
goat woiTld be a. baccalaureate degree. Altho!^^^^^ differential frligi; 
. faiTity\is still a viable part of the statewide structures and 
' proce:$s'es.v. the 60/40 rati o^ is not. " 

The implications of differential eligibility standards for pro- 
gram review .are more s|^tle than those of differentiation of 
functijDrt: o 



,6 Baccalaureate and master* Siprbgrams.at^ University bf .'- 
;. California may be. dTSt:fnguished^frbm th^ 
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' State University and CoTleges by the scholastic qua! if ica- 
tions of their studentTs as well as by program content. 

0 The exi'Stence and distribution of _lower division academic 
■ tr&nsfer programs in the Community Colleges appear to be. 
the only ass,urance- of .access to foyir-year programs for the ^ ^ 
schol astically 'lower, two-thirds of high school graduates 
at CI east those who cartnot be- admitted to a, four ^yeetr- segment 
as. an exception to regular, standards. , , - *. -,- 

0 Remedial education t|i the Community ..Colleges is a matter 

..of statewide concern to the exten^tha^t differential and... 
. hi'c(irl|r selective eligibility-^sttndards are supported by •, 

Unplanned Diversity . Segmental program review! procedures are 
part of the goverrftng and coordinating processes, of three very , • 
different segmental organizations. Some .five 'major differences ; !. 
are relevant to this*' report: ' ■ ^r-r'>'.; ' 

• Legal Structure and Resporisi bi 1 ity The muTti campus Uni ver^| 
sity of California and California State University and Col leges /- 
have governing . boards, but the Board of Governors of the Commun- / 
ity Colleges is a coordinating board. Far more than the two four J 
year segments, the Comrnunity.C^n^^'central off ice depends on ^ 
specif ic statjjtory 5U!t.h6rity to'*oi3tain compl;.iaoce from the loca1l|' 
governed institutiofefdr which it is responsible. '"V^ii 

/; , Size . The University. of California has nine campuses; the' 
ea1..iforn.l%5tate University and College§ has;i,lS; and the Commun-^ 
ity College central offic^ is Vesponsibte for 106 colleges in^^;. ' 
70. districts. Program •r^V-.few procedures, that are desirabl^nd 



feasible in one segrijejit may not be' ijnVt^^^ because 
of the numbers of programs and institutions involved. 

- Financing and Budgeting , The' two four-^y ear segments receive-^ 
/state f.urfding based on the numbers ;of students that they expect tr^^^^ 
to enroll. Although the bulk of fun^iS; so recei-ri^'e 
tb the i ns ti tut i ons accordi ng te t h^ir p)rojectedT:6lff^^ ; V;; ■* 

e3ch 'segment can shift some funds among iiistituti(5i^|^^^ V 
need arisesr. The. Cqmmunity' C©jllegeSi on the other' halH^d^^ 
s^tate funds based pri /aiCtual; student attendance in courlB^^ahd . v/-' ' 
: prpg^ that have been approved for funding byo the segmental 
-;fientral of f i ce . Wi thi n -a'Teasonabl e tpl erance fpr the accuracy ^ 
of projections (2 perceVit);-:i^ segments hislrdrically 

have adjusted to closerf-ehd- fundi hg;^i^^^^ almost . 

■vtotaTly .open-ended funding of the Gommunity 'eol leges . The. e^cact 
'■*form of futljrfe Community College funding is uncertain,- but aban- 
donment of open-ended funding is almost^^^^ ' " ' 

Faculty Roles . The §ystemwide Faculty ;Senat^ 
sity of California' has format responsibil4i^^^^^^ anid de- 

gree;s%. and it plays the major, substantive rp|e i P^o* 
gram review. Fa^culty in the State Unfverisi^^^^ 

riot had a similar roleVin segmental progir'am review until the recent 
establishment of a segmental Planning and Program RevieW"Ct)mniittee' 
ori which tl^e;ir;Te^^^^ sit — "the committee is adyisoiiy . 

to the central offfce' administration. Faculty at the Gbmmufi.lty^ 
Colleges have no role iri segmental, program review. ' v , 

" /.^^<:* / ■'V^ ■ \ ■ V ' ' , . • ■ 

The findings and recommendatioris-whi follo^/ recogni2;e , existing 
diversity and the, value of continuing it. They alsq r^^^^ 
thi^^^t this diversity has been fostered by, and is,a :fiartrof , • a 
state^supported system of higher educatHi)n. v Althc^^^^^^ 
by historical origins,' differences in legal authon ty, and by 



vScV^'^^^^^^ <*f funding f6rmulcft.»iJthe interdependence of the institu^ 

."••'v^^^^^ in in three segments Is re6l.-_' The Commission and the seg- 

4;-, • mentefl central offices must manige this interdependence, for they 
Is^" ; -^V^ have respcihsi Wllty for etonomical operation of programs across ; 
i^^'iC- v^^^B campuses' and for . student access on a geographical l^asis — ,for / ' 

the distribution of programs across the state. State and^seg-. 
Si^^V^ " procedures must evidence accountability for program di'stri- 

^^^Si-^. must not Ipse sight of the fact that only institutional 

' ^administr^sltors can assure that programs, however distri- 

- ■ . . - ■■■ . ■- * - ■■ 
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: PART II. REC0W1ENDATI0WS 



Our reconmehclations envisage an increased role for state and seg- 
mental program review, but, for the most part, without increasing 
current\|fcate aitd- segmental authorityl Th^ first I'jr^^^ 
of instructional quality must remain at each institution. The 
nine recommendations ;faiT .1jitD''^^^^ overlapping areas: 

plahni ng , new progranfvp)rocedd^^^ 1 i ty . 

1. Strengtheningrstate and segmental planning in its relation 
_to review of; new and e^ci sting jirograms is. emphasized in \ 
. the first five recommendations for: "w^" 

0 bisitrg review of new and existing programs on operational 
. state and segmental program, pi ahs (R^cbnmiendation 1).; 

0 developing operational segnental program plans and insti- 
tutional missions (Recommefidatjioh 2); 

• 0 integrating segmenta;!, program plans into state plans .. 
V (Recommendation 3 . 

2. Simplifying new program review . procedures to emphasize state, 
wi^e concerns is stressed in Recommendations 4 and. 5 for:.^-;-' 



0 shifting emphasvfs away from review of \deta>j|'e[^ 

to projections in program plans (Recommendation 4); \ 



0 reducing the. number of .'^etailed proposals subject t5^ 
review by the Cpmnrissi on (Recommendations). 

3. Increasing accotintabil ity |pV Educational objectives is 
the fir\al four recoimendatiohs for: 
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-0/ increasing reliance on institutional and^ segmental re- . • 
views of existing programs ((Recommendation 6); , . • 

b identifying and addressing statewide issues across seg- ■ 
mental boundaries (Recommendation 7):; • 

0 assessing the implementation of a small number of newly 
established programs (Recommendation 8); 

0 eliminating the direct relatioriship between, program and 
course approval and. state funding. in\ the Community Colleges 
(Recommendation 9). ^ .° 



o 
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RECOMMENDATION l! THE COMMISSION AND THE SEG'MENTAL CENTRAL OFFICES- 
SHOULD BASE REVIEW OF NEW AND EXISTING PROGRAMS ON STATE AND' ' 
SEGMENTAL PROGRAM PLANS v ' . , 

Academic program" planning in^ California's publ ic sector should 
cdhsist of at least three levels of relatively formal activity:- 

. IV Each institutioh should have a mission from which operational 
objectives can be derived to justify continuation of existing 
programs and to petnnit projection of new ones. 

2. Each segment, should have, operational objectives in program 
plans under which existing programs and those projected 

in campus plans can be analyzed and related to segmental 
concerns that cross institutional boundaries. 

3. The Commission shoul d have . a state plan under which existing 
/ and projected programs in segmental plans can be analyzed 

and related to statewjde concerns that cross segmental bound- 
aries. • ■ ^'"^ 

■ . ■ .. '■■ .\ •' ' ■' ■' 

The majar criterion in evaluating either an existing program or ; 
one that is projected for future establishment shou^ld be its con- 
sistency -with, and contribution to, an Institutional mission; 

Discussion • ;^ / - - ' 

The major finding of, this report is. that state and segmental reviews^ 

of new and existing programs, are not guided by ordered expectations 

of the relationships between academic and occupational programs ' 

and state and segmental policies and planning objectives. Currently, 

on a progr^m-by-progrant- basis, each new institutional proposal 

is measured by Commission and segmental central staff against . 



val id anji importarvt,; but almt^t free floating, concepts that_ in- 
clude, for example, differentiation of function and unnecessary 
program duplication. These fragmented- reviews are blunt instruments 
at best for reaching precise programmatic o,bjectives. Is a new 
program "unnecessarily duplicative" of one at a nearby campus? 
The question can be answered only with knowledge of the institu- 
tional' missions and objectives-, of the segmental pi ans for the 
institutions, and of the Commission resolution or integration 
Of segmental plans. . ^ 

We have no evidence that fragmented program review has caused 
ahy harm to higher education in. California. is difficult to 
know whether past controversies woul d have been avoided by pro- " 
gram plans or whether they would have merely moved to an earlier 
stage of the process. Probably, however, programrby-program review 
of detailed proposals has caused little. harm because it has been 
out of the mainstream of governing and- coordinating concerns at 
the state level . In a period of growth; most new progr^ips ; cou^^. . / 
be a usti f i ed wi thout di f f i cuTty . More recently ^\ parti ciilar#^" 
since Propositi oa 13 — programmatic. is sues have been subsumed 
under more urgent fiscal o.nes. • 

Even in-fragmented form^ Commission and segmental program reviews 
have been of some help . They have not been i dl e. exerci ses , "Tw 
^^ey have been a forum yi which- statewide issues ajad objectives 
have been brought to be* on specific program proposals. Each. . 
successive level of the currently required reviews of detailed 
new program proposals doubtless added something of value ta the. i 
programs. But the incrementaT values added were. unlikely to be 
worth, the costs. . " ' .■■ 

• ■ '. ■• ' " ■ '» ' '■ . . ' . 

. More shouldfbe expected of the program review responsibilities 
of the Commission arid the segmental central offices than that 
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they cause little harm and achieve some good. Reviews of new 
and existing programs should be one of the major ongoing pro- 
cesses for maintaining jbhe largest and most prestigious system 
af publid' higher eiduca1:ion in the United States over the next 
decade. The balance of our recommendations state our belief that 
this more valuable role can be achieved .by: ; 

0 placing review of new and existing programs on the firm 
.-''^ foundation pf ins titu^j|^nal , segmental, -and, state program; 
V plans; , . \ 



0 simplifying procedures for review of new programs to high- 
light statewide issues for. resolution in the conte'xt of . 
: proigram itl^ • . 

0 . mqd^i-fying procedures for review of existing programs to 
V"^ r' /Vea^^ for the objectives in pro- 
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RECOMMENDATION 2. ^ ALL SEGMENTS SHOULD CONTINUE CURRENT'EKFbRTS TO . ' 
DEVELOP OPERATIONAL PROGRAM PLANS AND INSTITUTIONAL MIS|i6NS FOR 
USE IN REVIEWING . INSTITUTIONAL PROGRAM PLANS. . v " ^; ; • , 

iSegnental program plans should aggregate institutional program pro- 
jections and relaiW, these to existing^.p^^^^ of gener- 
ality dfetermined by the need to resolyje relevant state and segmental 
issues. Segmental program planning. should reflect unique segmental 
responsibilities, organization, ■ and governanceipp to be operational, 
each segmental plan should: •. 4 

.0 be based on a current inventory of existing programs ; .C;.v 

J .' ■ •■•ru-:-. : ' •* ^ ^ . . ' . • . ... . : 

Os state, campus missions, with at least enough specifipil;y, t^^^^^^ 

elude objectives of existing programs or program" aVeaiv - ^ 

0 ' anriuaily project planned new programs or program areal^ over 
the next five years; - . 

» ■ . ■■ . , ' . 

.0. relate prajected new programs to segmental objectives, insti- 
tutional missions, and similar programs' elsewhere in the state, . 
; : segment, and region, where appropriate. 

Discussion 

Ihs'titutional missions and segmdWtal program planning are probably 
more important than state-level Commission planning. Segmental ex- 
pectations of institutions can -- at least in the two four-year^ seg- 
ments — be encouraged by governing authorit^ver budgets, -personnel 
and buildijigs, as. well as by program pi ans .and program review. . It y/ 
is not accidental that program planning in the Commission and in 
the Conmunity Colleges, both coordinating ^- not governing — agen- , 
cies, 'lags behind that of the four-year •segments. J<or is it a coin- 



cidence that program planning in the State University and Colleges .. 
appears more effective than that in the University of California, 
for the demaffds .qf planning at segmental levels place it in the hands 
of administratprSorather than faculty. Administrators in the Cali- 
fornia State University and Colleges central office have almost 
comp^lete control over academic programs, a position enjoyed in the 
, University of California by the' f^^^ 

Differ*ences in governing vs. cqordinatihg authority and in admin- 
istrative vs. faculty influence create differences in the ease with 
which, effective planning ican be achieved and in the precise form 
that it can take, but they are not excuses for avoidance of planning. 

Cbnmuni ty Col lege j^rdgi^am': PI annfng 

Currently . itVis easy to criticize segmental planning in the Com- 
munity Colleges, but is is equally easy to understand the many prob- 
» Jems that make planning in this segment almost •astronomically more 
difficult than^in ei.thiar the University of Cal if orni a or the Cali- 
fornia State University and Colleges. It is far:mor0 difficult to 
suggest solutions than to state^|th 

The Community Colleges issui^pf^ve-Y^^ 

Colleges, 1976B)-and update^J/it^, ap^^rs/ to 

on program review. Institutional prd^ri^^^^ 




(Cal i fornia Cqpiunity Col leges ,;5l979A,^^: ^^^^^PK^SP^ 



ission witfiout^^ by 



gram projections are sent to the Commission without-^fl^ 
Community College central staffs and the Commissibn^rstaff do not 
analyze them because of their apparent inaccuracy (See Appendix A). 
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Planning in the Gommunity Colleges doef npt^rovide a fruitful 
J^context for ^segmental program review. . — 

As a planning, agency, the Community College central office shares 
, w/ith the Conmission the problems of being primarily a coordinat- 
ing body. The sheer number of. districts and campuses and their 
'. great/diversity pose obvious problems, and so does the dependence 
/of program offerings — especially occupational dn^s=^— on widely 
varyiTig', sometimes rapidly changing, local ' coirtnunity -needs. Most 
recently, the greatly increased dependence on state funds had 
dominated^ and continues, to dominate, Comnun.iiy College central, 
office priorities. Four additional limiting conditions on effec- 
. tive planning are found: ~ . , 

• i . 'irH:ompliance with. legisTati mandates, and assuring district 
:': .and college cojTipliance dominate^ppral staff activity. ■ 

> : . - ' : ■ jhe number of mandates is legioafwussbaum, 1979A), and 

. - mandated prior review and approval of all new credit pro- 
grams and courses, is one of particular concern to this study. 

2. The Comnunity "College central office complies with the legis- 
lative mandates as best it can within limited resources, 
. but lacks an organizing purpose from which compliance with 
. what the'^'Stw requires can be extended to educational leader- 
' ' ' - ;. ship to benefit .students and the state. 

. -/ 3.„ The cSnmuni ty. Col 1 ege central staff - concerned with program 
review appear to view the districts and colleges with dis- 
trus^t and suspicion.: . Some- tension between the coordinators 
and the. coordinated is both inevitable and heal thy, 'but . 
■ the attitudes of the.pommunity Co^ ege central Staff were , 
' v . quite different th%; those found in the central offices \ 

.■ ' ' of the. two four^year. segments. 
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4. In urban areas, district boundaries can artificially limit 
student access and rational program distjibution among *ad- 
jacent districts. At the Same time, very large; multi campus 
districts can plan for, and differentiate among', a number • 
of colleges serving Targe- population centers; 

These foiJi^liIT^Sting conditions,^^^^ serious, and the first three 
may bis inherit in the lack of clarity of -purpose or mission of 
the two-year colleges.. An experienced and perceptive observer 
suggested that the two-year institutions differ from the four- 
year ones in lacking public consensus on their offerings. .The 
dominance of mandate over discreti 0^1, the uncertain role of the 
central office, and the distrust of districts arid colleges may 
all have a common source in reasphable difference's, of. opinion 
about the substance of two-year college offerings. Ef^^^ 
program planning and rev.iew in the Community Colleges ma be de- 
pendent (Dn resolution of disputes over educational matters — 
controversy that is oversimplified under the rubrics of "basket- 
Af/eaving" and "macram^." 

Reconroended Change . The Community College centraloffice should 
assume a leadership role in educational policy in its areas of 
statewide responsibility. It should require realistic district 
and college^ program plans, should (develop appropriate classifi- 
cations for analysis of them that are related to stfitewide con.- 
-cerns, and shauTd -prepare segmental program plans that reflect^ 
such' analysis and state and segmental educational policies. 
Historical origins in the public schools^ lack of pubHc andp- • 
professional consensus on program offerings,- largelyicoordinating 
ratlier than gpvening authority, and complex and uncertain state 
funding pRacedures combine to make effective -planning in the 
Conwunity Colleges far jnore^ difficult to achieve [than in the* 
other two ^|t)l1c segments. \ 



i" ► 

■/ 

Califbrnia'State University and-^Gbl^<^es Pro gram Planning 

Currently . . Program plannirig;^ff t|i||^l ifornia State University 
and Colleges is highly structured at the. segmental level , and --I 
has a. long history. New prtf^rams are projected by campuses and ;;,; 
reviewed by the segmeh'tal central office in. the .i^ntext of tho?|^.> 
projected in the .plans, of all campuses (.See Appendix C) . , Until - 
recently, however, empfiasis has been on review of the detailed 
proposals that are subsequently submitted.. Currently, review 
of projected programs is receiving greater emphasis. v.Planning 
procdijures have been recently modi'fied to require that campuses 
justify the new programs that are pt-ojected in plans in terms 
of: campus mi ssi'ons-. . The addi ti onal planni ng requi rements seem ^ 
directed primarily toward improving campus academic planning, 
but their benefits also enhance the program planning an,d>reyiew 
capabi.li#Ns of the central office of the California State' Uni- 
versity and College's; Attention is being deliberately shifted 
from detailed proposals to program projections that are briefly 
and express'ly related to emerging campus.missions. 

Recommend^d^thSriqe! ^ We assume thafnh^hift toward greater em- 
phasis on. review of program projections will continue and that 
the Commission will be informed of the results of the.analyses 
whenever appropriate. If this is the case, the procedures ^in . 
the California State Universityiand.^^^ C^ may provide 'a mod6l 

for the other; segments -- not.i|i||^^st3ecific formal procedures, 
but rather of the concepts thl!^^fs'.Vecommendati on endorses. 

^ University of: Cal iforni-a Program Planning 

y ■ • _ ■ ' . ■ ^ \ 

Currently . Unive*rsity-of California program pla.hning at the seg 
mental -level is .in the final stages of.changte. At present,-the 
central voffice collects campus projections of new programs by 



title only, largely, we..feielieve, bec^^^^ requests 
that it do so. These prpj.^clions are fqw^^ to the Com- 
missfon with analysis .being limited to reconciliation of the c^^^^ 
rent projections with earlier ones (See,,^pjarendix E).. Progranls ; 
so projected range- from those in the 'final, stages of ^apprdvat 
to those that ar^^'ere- aspirations. The segmental; FacuTt^ 
(to which authority over programs ^and^ courses has been delegated^ 
by the governing board) does ' nqt 3^^^ to* be* a party to the pro- 
jections forwarded to the Commission. In a structured, but largely* 
undocumented, three-year rolling resource allocation process that 
involves a number,of "campus visits," campus rP^'ogram plans arid ;iV 
projected'^progr^s are discussed for both bludgiet^ry. and academi<;^^;^ 
planning purposes. yBowen and Archibald, 1977,'vp(p.. ;i6-^17) . . : % 

Reconmended Change . ' Although still- under' discussion, emef^i^ig/ . 
Uhtversity of California planning procedures contemplate that \ 
the central office will; re^Hew new programs.. to ac^ve "their , 
consistency with major Universitywide objectives ... -[and] -.w. 
selective coverage on each ciiTipus in light; of local strengths, 
and oppprtunitifes^ (Uni:%y^sity of Califbrnia, 1980C,':pi" 52). 
Developing more precise campu^plff^^slons -- "selective coverage" — 
after , a history of "general campus" aspirations Will not be easy. 
It is necessary, however, and should result in more informed jus'-^f^ 
tification to the Commission than/Yn;the past of new programs ? 
that, on, their face^ are duplicative pf those at other campuses. " rife 
And responstbil i ties for rese.ard^/ahd doctoral education, along 
with the legitimate authority of the faculty oyer academic pro- 
^grams will probably prevent, University^of California program plan- 
ning from being as orderly .and formal, g^^^^ in the California 
State University and CpTleges. The clijin^es recormended^^^^^^^^^ 
report appear consistent with the direction of emergihlg-vpr'b^cedures 
in $he University of, Calif orni a. . • 
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jREGQtWEfjp^^ ANNUAia INTEGRATE SEGMENTAL . 

^pimm plan that incorporates existing : :J . , 

:Vr&^JJS'.A^^ for ^^^^ YEAR PERIO[I.-.n'^^^^^^ 

, The^Cbit^lssf^ responsibt^ity -fot preparing a five- 

year"*state plan for ^^^^^^ education and updating it annually • 

should -be in te^^ include integrating segmental program 

. pi ans> into a state program Such a state program plan would 
be in adidittpn t^^ not a substitirte. fq^ current i ssue-oriented 
Commission planning processes. ,;At^^;7^ the integrated^: state 

prpgfam plan should ./ " ^ \^ . 

* ? • ■ . ' ' « , . V ■ , " . . 

^;:V ^' -^-vlist the nev^-pJfogramSvl^^ - ■ . 

by tt;t"le and by projected 'date for establi'^hment; ' . " 



- • .-o- tilent^ i ssii^SV J^^^^ ^the . prO;^ 

■ ' ■ V" jected-::new. programs ; »v ^V > 

^ 0 detail the resolution of the^stsV©^^ 

0 identify issues to be included in th&'Tev1eW.itff^^^^ 
' . program plans for the following year. . W'P^. 

Commission a nS'segmen.t^ central offi^ce staff should jma^k^:(3iV 
efforts in the prbg^^^^^ planning process to resolve/most s^^^^^ 
. issues — e.g., possible .unnecessary .duplication, appropri^eV 
differentiation of.rJunction, etc. at leas't two years prior 
to the date >lanrtarf for establishment of the projected new program, 

• Discussion ^ ■ - . - 

The Taw. and current Corranission guidelines for progr!am review are ^ 
. we< be! ieye-oonsi Stent ^^ith .this% recommendation.^^ But change^^^ 
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• » 1; ' • 6 > ■ • . ' • r-, ' . , .' ■ _ ■ 

requiVed because practice; ^^^^h^ not, des^)ite gobd intent, been^ con- 
-sistent with policies. Commission. st?iff Ms justified. .in:\attri- 
buting much of the^ inconsistency of practice to shifting policy 
priorities; 'turnover. Of '3^^^ arid leadership, some lack of respon- 
siven^ss of one segmental- Qentral off i and, most recently, ; 
general* disruption -in the aftenriath-^^^^ Proposition 1-3. ^We/dte 
notVuriderestimate these difficulties, many of which wil 1 per-^ 
stst, but if effective program planning is .given higher 'priority 



by thfe Conroissldn, i»t can be achieved. 



Currently ; The emphasi s .g.f^the ;€ommi ssion in its first Five- ^ 
Year PTari (California Post^ecbndary Education Commission, 197 
'has .been on statewide Issues t^^^^ related to specific ; ... . 

pi^^^^^^ continued^ ^ , 

r ■ it InfbnnsUConm and responses at the. state- lev^i^r;^ ^- 

* in itSidifficult -and tefiubds'inlcid1e^p0s^it the; segments. 

\and State government. -But the. Commission's statutory charge to 
"integrate the**plannirig efforts of the.putiXic se^gments"^ 
Code', Sec. ^615903^^^^^^^^ be interpreted 'to include another form of - . . 
planning: -E^^^ c%n>be ^ 

ordered along wltHvpr:oje.cted new pro that gire in the/^Dlafi- -'-^ 
ning stage. The precise f<)rm. of order^^^^^^^ 
. reason for ana lysis 1^-.- ^^.W^^^^^ iritegratipn aldrig'^^^^ 

originally contOTplated^^^^ become incidental to . 

: J^^ planning i[e.g. ^ th^ .limited dis- • 

\ cession of plarining-and pnog.*^am review relationship^ .in a recent . 
uptiite. California •Postsecon^ - 

":^::^.j'> -pp. -29^30)., ■ ■ , . 7;'- ■■' • '-y---. ' 'i f > \ - ■ ■ V 

Bedatfsie integrated prggram pi annfni^^ is lacJjing, the segments cur- 
only the; titles of projected programs at the pl an- 
nfng stage. This weak pfrocedur^q. leads staff to^^t^iew^highly - ^ . 
' detailed new program/proppsals on a: frac^ented, program-by-pTQ[gram \ . 



eric;.-,;:/ ^-^vs: 
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basis. Detailed proposals encourage probes of curricular and 
' Itafcffing- det^ls to tH|';:d^^ attention to statewf de 'conr 

*ceims and institutionaT miss^^ ; ^ z \ \ 

Recommended .Change . Commission staff shQuld'^deVelop an .integrated, 
'pro^iram plan from segment?!" prrogr am .^^ The Comraissipn(and 

-'iShe. segmental central oi'f ices should resolve :stat?w1de issues : 

.^9S trey aris6 in -projections of progr^^ 

advance of their as t^blisfiment^ ^Resolutl^ii'^sfiq^ , . : 

ferred tn'the absence of explicit justificatip^^ pending 
or proposed studies oi^ on a need for additionaT information diredt- 
ly- related to'^the program undfer consideration . - ? 

The intent Of this recprrimehdatTonHs require the . -Commissi on 
to exjunine new and^ existing programs at a level of generality 
appropriate to Its state^^^^ concerns— to examine the .forest 
f r|ither than the trees.:. It -is not the intent to hsive; the integrated 
"'«5t^te: program plan be one from whieh deviation woiild be considered;: 
. a def^.' Program pro jejct ions ftave not tie^n partlcijlarly reliable 
I'in the^past (Elms, .1980/ p.^l78;i \ 
although reji ability may increase when more than a title must 
be projected, isut^^^^^ change over time, and'respohse to these ; 
may be urgent, "particularly for occupational programs in .the Gommu-' 
'nity Colleges. Changing needs, social conditions, funding, and 

faculty minds all require an expectation that the integrated; 
srate program pUn adapt with ease to additions and deletions, 
of^rojected programs. ' ' ■ / ; • • 

The Commissi on^/s integrated state program plan should be cons id- 
ered; primarily a framework for* analysis. Only $ecofidarily, if 
•at aTl, shoLild f^be, taken as a reflection of • Commission expec-; 
'tati 6ns:> that parti cul ar: prograrns wil l be establ i shed on a day* 



»;52 



certain. This '^^^^^ inti&nded ,:tb fociJs jiot tq^-increase^ 

jithe (^mroissiohf'^'l^imi.tecl authority:: over,- and ^i^^^ for, 
academic program plafining.> ^-"^ '^^^ ^ ^ 
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#Sfibu.Td'.t]ilere be'}f^^de^4^^^K^^^^ the .ir^egrated state program 

plan With i$s orderly prdject ions, of r^w'^programs into tile future* 
. Certainly^ facuHy and adm*riTstrators''at^.etach p^^ |nst4ftution ^ 
should '|knqw the Dreseht ;|^^^ pfi, jtl others when thjise hav^ reached^., 
tfie stage of forral projectidrf. t)n the othep . hand, high school - 
and other student couhseljors might wisll give . project f on s iih.a \ 
formaTV widely;/distn more credence than is warrentedf . 

current 'projecttbns of tfti^i Univfersit^ of Cal iforhia. and the Statei. \ 
University a-nd Gelleges that a reviewed by the;Commission\ar^^^ 
not^/idely M:it^triJbute(l for? that reason. We wo^ld urge as wide 

a'-^istr.ibution as, possible, but with suitable warning a 

■ .v>^ { '* - ■ ■■■«,.■ ■ . . ^:-■ 

possibi^it1es of change. : * . ' 1^ 

c.'' • ■■ . ■ ."-^ ■ ' ^ • ■ ^ ■ .■ ' ^ 

Implementation of this recommendation /should 'not increasis 'Commission 
staff worlcload. Tim^ now used /for reviewing detailed^ prop^^a>s, 
"i'would shift to i^eviewihg them as projections/in segmental plans. 
The recommendation would require closer working relatiansfitp6 
betWeen>^Commissibn;/pU staff 'an(J ti|pse responsible for pro- 
gram review.- ' : 
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RKOWENDAtlON 4. .THE ^COMMISSION, /IN REVIEW OF NEW PROGRAMS, : 
SHOULD, SHiFT EMPHASIS FROM DETAII.ED INDIVIDUAL PROPOSALS. TO SUMMARY 
PROJECTIONS OF PROGRAMS THAT •APPEAR' IN SEGMENTAL PROGRAM- PLANS.. 

The'Conmission should evaluate new programs at the planning stage , 
and at a level of aggregation and generality ttiat is appropriate. 
1^br consideration- of statewide concerns that, cross segmental bpund- 
aries. Institutional program plans and the segmental program^ 
plans thaS aggregate consolidate them should praject, new pro-,, 
grams ffom^two to five years in advance. As part of the state 
progran] planning process,' the Comnissidn should be fur^iished With 
a substantive, but^brief ^ jiprospectus" of each projected program 
tha| would inplade: • .j 

0 a descr^iption of the program, .as wel.l as the title; 

0° a statement of the perceived need for the programV-^ 

" ; ■ * '• , ' .■ 'V'. ■ «• , 

0 a Statement of the relationship pf the program to ^the /instil 
•, tutidnal mission and to other programs at thevinstitutidni 



: . 0 an ideni;ification''of the statewide or segmehtwide iss^^ 
':if any, presented by the projected pro-am, and a state- 
ment of their, resolution or proposed Tesolution'. 

Segmental central offices should consjder sim'ilar shifts in emphasis 
in^'their ^evtew of "new proVams planned and proposed by institutions 

■ Discussion i ' ' . , V 

• ^ ■ ■ .' • ^' ■ ■ ■'■■^ ' ' ■ . . " ^ . r ■• ■ 

, ., , . '-^r- : ' . ^ •■ .. ■ ■ V ''^ . 

tSis recormendati<)n complements -those for prpgr^ pi anning struc- 

:tures and processes. Program^ anning will enhance the capacity 

of the Commission and the segmental central office?; :to reach jand 



resolve issues of statWide^ and segmental concern. / Implementation 
of the present recommendatibri wfll simplify and reduce institutional 
invdlyemsnt in Commi^l^tpn processes/ . / 

'• ' . ■ '■ ■ ^ ' ■ 

Donald- Sm\th (1980, p- 45) states that a primary function of program 

review' at. the state and segmental level should be' "establishing 

\. . ■ .■ • ' , ■ . . . ■•■ • . '' 

axontext within which effective institutional processes of pro- . 

gram review are at once encouraged, .facil'itatedi, and made necessary. 

Current requirements that every /detailed proposal for a new program 

must be subject to review by the Commission are not a^context 

for effective instltut^ional planning. 

Opinion was^naniitious during the.^interviews^ ^^t^^ prograrf 
review requires that those conducting it believe in the, usefulness 
of their efforts^. State^and segmental pal iciefeshou.^# encourage'' 
campus* perpeptions of usefulness by al Towing witest latiUide 
for institutional ^election of policies'^ and procedures for devel- 
oping their own evaluation practices (Smith, p.K-V 1980^ p, ; 47) • 

At state and. segmental levels, the easy decision is to^ "ask for 
everythi ng from everybody, " and then. |q . s^^^ s gi ven 

for solutions. / The easy decision* at/|hese levels . is not the easy 
one for the institutions, nor is It the. most likely one to reach 
critical statewide issues. A more diffic^^^^ 

discriminatioiT'1)etween what should be required from the. institutions 
and what should not on grounds of explicit statewide or segmental 
' concerns: Itos this more difficult .course that is recommended 
"here./ • . . ;.■ ."^ ' ." 

Currently . . The law requires the Commission "to review proposals 
. by the public segments for new programs" (Education Code, Sec. 
66903). ft defines new programs as a sequence. of courses leading 



to a degree or certificate, and appea^^ limit these. to programs 
that "have not appeared in a segment's or district's academic 
plan within the previous two years..." (Education Code, Sec. ^ 
66904). ; Conmission guidelines 5tate^ (Cal-ifornia Ppstsecondary 
Education Commission, •1575, p. 'F-6): : 

• . • ^ ■ > ■ ' ' ■ ■ ' . '■•»■''■ r '•,:.'.•«'• ■ f 

"By considering prbgrams ,two to five years prior to their 
fntended implementation date. Commission staff will diminish^, 
the need to subject each program proposal to intensive review.. 
'' The staff will nevertheless. requ^j as;. i^rifortttatipn co 

proposal s for all programs appro^^d by- t|e ^segments and xil 1 • 
reserve the right .to comment on any" proposal submitted J' 

in the absence of integrated program planning,- projected programs 
have not been screened out. In 1978, Commi ssion staff identified 
over .1,000 projected programs as representing' possible unnecessary 
duplication or questionable need; and stated, that these would 
"be reviewed thoroughly by Commission Staff" (California Post- 
secondary Education Commission, 19788, p. 15): This large number 
should be contrasted to the 139 new program proposals actually 
reviewed in. 1976-77* and the 136 in 1977-78 (California Postsec-:, 
ondary Education Cqpnission, 1978B, p. 1). ^^r^stead of screening;, 
out programs at the pi anni ng , stage revi ew;. pf pro jected^prqirams •^ 
has. been a net in which they mri;t^^^fOT -^^ 
■review. , .. . . ' ■ ' ' i' ■ . ■ 

Our criticism is of the process, not of staff , Whose fault, if 
any, is. in overabundance of-eaution> An operational program pi an^ 
nin^ context does not exist, and ^only the titles of the projected 
programs are availably for review. Caution is understandabre, 
qn#he other hand, , the far ge number of programs identified f or ; . 
-"itensive" ■review 'in 1978 is some evidence of little attention 
to^the cost.of the dautlon. Interviews provided additional evid- 



lence'at both Coirmission and segmental' is.taff >e^eTs. We did not \ 
find as much concerh as we expected about the burden that prepar- 
ation of detailed new program proposals imposes on inrtitutional 
faculty and staff. Yet this burden obviously erodes time avail- ; 
able for primary responsibilities; moreover, it discourages risk 
and may encouratge controversy: ' ■ . : 

0 The establishment of a new program ent^iils substantial/^^ 
on the part of its proponents particularly; now t)!^^^^^ 
port must be drawn from another part of the inst-itution;;.. \' 
Risk must b^ncouraged/' however, for neither expanding^;; '.^ .' -^^^^^ 
knowledge .nor /Community needs will diminishj because of de-.:, -.^ 
clines in' enrol Irnent or state revenues. Unnecessarily cum-; ' 
' bersome procedures have what a college president called* . 
a "chilling effect^on institutional initiative. InstU 
, should be able to test creative ideas at- segmental and Com- 
mission levels without the burden of preparing lengthy^and 
detailed proposals. 

0 If faculty and admin^istra tors may be reluctant to undertake 
a new venture because of burdensome procedures, they are 
reluctant to abandon even minor facets of it once a detailed 
proposal has been prepared. Current procedures probably 
assure un^necess^rily spirited defense of trivia.' 

RecoTTiended Change . Under, this recommendation, Cornmission st^ff 
would reviey/- short,, summary prpjections of new programs rather ^ ' 
than detailed pro^^ 

p >New^ programs should be projected in segmental plans at least 
Iwd^years in advance, and the Commission, should be furnished 
■ , . with a brief but substantive "pVbspectus" for each. 
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6 Either by coyer letter forwarding .institutional program 
projections, or in a segmental program plan conspl idating ■ 
these, the segirental central offices should advise, the ^ . 
. Commiss'^ion of segmental and statewide issues presented and 
the resolution of them. Segmental' submissions, should review 
the pro jected^prb'grams. of Jli the^r institutions for the 

• entire- period for which projections are, made... 

Our recommended program planning and review procedures wouTd sub- 
stitute brief statements of projections for mo?t types of detailed: 
proposals. But even "greater simplification may' be possible:, 

0 We seriously question whether the Comm^sion shou¥ ■review., 
new occupational certificates either as proposals .'or as 
projections. 4?apid institutional response to changing ; 
' employment marke|&:,isj;npt: conducive 

. planning. Moreove#v;_i^^ ' 
state-level pfanrtYng I'n^'prdgf am review are not likely toV,; 
- include sensitivity to the noncollegiate roles of. the two-? 
^^ear colleges. : ' ; ' " ' 
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0 Proposal s for jlCw undergraduate degree^ programs jn . tra<^ft.ional 
■ " liberal arts areas from the University of California,, afrd^:; "^^^ 
■ the California State University and Colleges are rfow^appar'^^^^^^ 
ently received "for information" only by the Cotfbissionv, -c^^^ 
although the right to comment on them is retserv6d..;,.at wou^^^^^^^^ 
seem that little of va.1 lie would be lost if«at5prpva,l 'oi^, all; A 
but certain specified baccalaureate, and associate degree 
' -programs were the responsibility of the segmental centraj^^ 
•'• ,:'-offices. . ■ . ,^ '. ':V 

the Commission cannot, of course," ignore all occupa^tionaT 

and all undergraduate apd associate degree ones. Assuran<^p;th^^^^^^^^^ 
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: instftutional offerings are within Mait^er Plan boundaries of 
differentiation of function need not subject every new program 
to possible detailed examination of curriculum, staffing, and 
the like. Specific statewide program concerns — e.g.', computer 

. science and technology, bio-niedical technology, etc. -- arise , 

• from an economic need to limit access on a regional basis, for 
example, or from articulation issues between two-year and four- 
year institutions. The Commission might avoid seeing even • pro.- 
jections for certificate and undergraduate degree programs that 
do- not fall within identified areas of state concern. Access 
tQ'segmentaT program plans would show when the segments were pro- 

;;gecting programs outside of. these/;?ireas, and cou^ alert the Com- 

-''^'roissiqn to elnerging state issues. ' 
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RECOMMENDATION 5.- THE COMMISSION. SHOULD^REVIEW DETAILED NEW 
PROGRAM PROPOSALS ONLY UNEXCEPTIONAL SITUATIONS. ^ ' 

fhQ Commission should base decisions: ^^^^ crri the 

.,suimary statements of the programs : that are pro j ected in' annuprK. 
Isegnental program plans. Tbe^initial projection. of a prograifr, \ 
tw8 t'i5:vSi ve years before its pi anned establ i^ment , mayv cons i st 
of t^tvio or three brief paragraphs, but it-should be suffic-. /■ 
iently specific to raise possible, substantial statewide'-i|sues -t 
e.g. .access, possible unnecessary program duplication, etc. Corn- 
mi ssij)^^ and segmental central p,ffice'-staff should identify, explore, 
and resolve these:;,issues as the projected date for prograp^^establish 
m^nt move^ forward in successive segmental .program^ plans. 

In exceptional situation*, the Commission may be requrr^ed to 
review-detailed propdisals, and may do so if: 

■' 0 The program has not been projected in prior segmental .pi an^. 

^ 0 the issue, is sy^?i that a decifidnjwpu^ requi;^^ 
, not -avantofe; Until shortly b^foV^e^,tiie : projected 

V progr^^estafalfshment ~ e;.g.-V a-^ 

ment trend^vih similar programs' at other campuses in. ^^^^ 

• '* region; or on completion of articiulation. agreements,, etc. ' 

The CommS ion, should not defer coipent on a program projected, 
' in "a segiiental plan without stating the reason for deferred comment 
and advising the ..seg^ei^ of the additional information required. 

• Discussion ^ . . , , 

This recommendation is separately st^d for emphasis. It is ^ 
discussed at length under Recommendftion 4 which proposes shifting 



the curl^ent emphasis away fro^ of detai>Te3 proposals to 

^arliiar review of summary statements of projected new programs 
in segmental program plans. ■■ ■■>' c 

Mthq^^^eyie^ of individual proposals without the context of 
..^^st3t6 or segniental ^ plan can reach ^me statewide issues 

i^i^e.g.j reminding a segment of its responsibilities. for, regional 
distribution of graduate programs), experience suggests that it 
may not do so (e.g., issues raised concerning a new school of 
public health in Sa.fi Diego) . /Additionally, fragmented examination 
of detai 1 ed proposiiti encourages excessi ve . attention^ct^^ curri cuTar 
v parti culars that aVe maftters of judgment for.. inst.itu%i;onali facul ty. 
^^iipp^ and s^ental program reviewer^- 5^ 

Inappropriate^ afead^ backgrouridiv i but thes$^ make, tt'-' 

t'lailtnost^iR^^ toV|i?iy6i'd; they were^ 'i-:- >^ 

■ 'ihemb^il^^^^ campus curriculum commT.tt^^^^ wh^n' faced with a detailed 
ipttf^Qpo^ experienced staff member :s;ugges ted that the detail 

"^^^^^^^^^^ proposals , submerge^: analysis of state or segmental 
Tl^S^^isflMnder; a^ of criticism of currtcular detgiils* V 

Currently . Because of lack of an integrated state program plan' 
and because of requirements for information copies, all detailed 
new program proposals are subject 'to review and comment by the '- 
Corranission. . ; . i 

" . • ' ■ ■ ■ . . ' . - • ■ . ■ ' ' ■ ! 

. *■ ' • ■ •■ • . . . ■ . . ■ ' ' ■ I ■ . ■ ■ ■ ■ •'. • 

RecoiTwended Change . Only brief summary statements, of- the new 
programs projected in segmental program plans would be: reviewed. ; 
The only exceptions would be those regarding" new programs that 
are. not projected: in plans and those that require specific studies 
or more current information than would be available at the pro- 
jection stage. 



P^^rhaps. the major problem that we foresee with .implementation y . 
of this reconroehdation arises from difficulty, in accurately • 
projecting Community College pccupaitional programs: \ 

^ Vb ' pccupational programs ' are intehded to b6 responsive- to cur- 
^- • rent Ipcal needSv and a- short lead time between perception^ 
^ V of the need and establishment of the program is esserrtiaV. > 

; It woin j seem^ W not prxijected in. 

. segmental , years , or mor|i in advance.ij^Quld be occu- 
pationei^-vP«^'gt^ 

. ; • ''nfentat;'0ari^^ ;'iy.^ ■ . ' g- ; / ■ ■:- • 

0 But. if the^Cdryjs^W^^ review :detai led proposal s of^ i^. 
. , 'all programs not projected-two years 'in advance of estab- . 
lishment, then niost of its r,eV|iws wbuld b& of detailed ; . \ 
proposals for n|w occupational programs. * Neither by _ _ ^ 

T . experi ence . nor qual if icati on,, are Conmi ssibn staff 1 i kel y 
to be sensitive, to 'local coiSufhity pneeds, to th^ instrue- 
tional requii*ements of occupational programs* Of to'the • " 
" possible urgency of establishment. " ^ 

J^'suggested elsewhere in- this report, the Commission might limit, 
its program planning fpr Occupational programs to specifically ," 
identified programmatic. areas, and rely on the Community College 
central office ta be the final review agency for the jreat bulk , 
of occupational Brpgram projections and proposal s'. .The Community / 
College central office 'shoulci con si dir. the necessity for its own 
prior review .qjfe,^alT of these progrjil^. 



J 



RECOMMENDATTpN^e . : ..^^^^^ 
^. . TO DEVELOP AND IMPROVE PKOCEDURES FOR S^^^^^ EXISTING' 
%,;.PR06RAMS, AND SHOULD SUPPORT EMERGING ^INipiTUTIONAL PLANNING: AND y 



:jjMflEVI0 PROCESSES. 



rs^jjhe segrrtental central of f i cesf sl^§pld primary' responsi bf Ti ty ' 



•It 



'^^Qt:, assuring that existing^prMranl.Sj^^a institutions are 

V / cbnsiste objectives and program plans. 

/ A - ;Oj^ baiiSv^ the other segments, and the 

iSloinmiSjSion should be advi^^^^ ' 
■ \ . > reviews of existing pr'ograms or program areas. / ^ -i. v 

■ ■."v.^^-^-v^.'. ' • ■ 

. , 0 The Community Colleges c^(lhtral off ice;should (I) determine , 
whether its. cuprent procedures for r^iew of existing 'occu-' 
- patifihal programs (COPES, SAM, etc ) are adequate to meet ■ 
\ segmental program planning responsibilities; and (-2) develop 
guidelines for identify.ijig areas \in which s'egmentwlde review / 
. may be .required to resolve issues relating./to existing academic 
programs. 

\ 0 .The central office of the Cal ifornia State,, University and 
Colleges should develop guidelines, for identifying areas 
,v ;in which segmentwide Review may be required to resolve seg- 
• ' ; mentaV program issues. '/ 

. 7^.0 :^ the- pentral office of the University of Cal ifornfa should ^ 
: ' :. develop, to the extent^fea^ible, comparable def ihttiohs V 

. ' : • of instructional data elements for use by. the campuses in - 

^ ; : riBview of existing programs. • ■ o 

." ■ ■ • ■ ■ ■ ' ' - ' ■ ■ ' , "" " . . ■ . ' ■ ' ■ . ■ ' ' ■ '■■ ' , • ■ ■'■ ' - 

All institutions should have program planning and review processes 
that relate existing programs, projected new programs, institutional 



tniss-fbn, and i nstnucti ohaT.;Sta1-^H;rig;:ie^ t^dgetai^'d^ci s 
The^ segmental central bffities ^sihbOld^eji^ suppor-t ^he; 

••development of these /processes'. '--^-K^v V 



. Discussion . ■ ; ■ 

A major function of "mul ti -campus'' •leveT p ; 
ducting certain multi-institutional; pr^o^r^^^^^^^ , 
purposes reflecting statewide' rather; thanVinsti^^ 
problems; or concerns" (Smith, DrK;.,; l980;;'pV-4^^^^ 
concerns arise both at thevCommission,' wh.ere ^s^ 
policy issues, ar^ brought to an intersegmental fpcus,^^ 
segmental central offices which. have" gebgr^pjliic st^^ 
biiiti^imcler the Mas-ter Plan Our primarif ctfhc^rn in;^t^ 
recommendation is with segmental review of existing: pr^^^^^^^^ 
across campuses. An equal ly ;impoi:|an|: tssu^ even . iii % 
of statewide program -review -- i s se;gmental;" central ;-p V- 4 

requirements for, and interest in, insti^utibiialVreyievvs^^^ 
existing .programsv-:/ .' . ■ ' '--^ ■ . ' '- '^-'^ ■ ' ■'"'^^^^^ 

■ Coronuni ty .Col 1 ege Procedttrss ; ' ' . :^ V 

^ Currently . Conmunity College procedures for revieW-^f al l 
pational programs, across all colleges: on a four-year: c^^^ 
substantially from those in the two' fouryyear. segments ,; ' Cof^ 
Col lege procedures : are more comprehensive, ■ invol ve . central : pff ice 
^scheduling; and appear to be considered a. permanent planning;;ran^; , 
.review activity: (See Appendix B) . Earlier evaluations of -the ' 
major element in the procedures -- The Community Co.llege Occupa-. 
tional Programs Evaluati on System (COPES) ~; recommended "Identi- 
fication of exemplary occupational education programs and pracv , 
tices to assist other colleges" (California Community Colleges,- . . 
"l976A, p. 11}; and. see Auvil' 1980, in which similar recommenda- . 




.tio.ns appear* for f ederaliyvf uhded prDjects ) . It 4s contemplated 
that .the resul t? of the four-year cycl€ t^evrews' will inform seg- 

•rtiental pTahhing- (Morris, 1980) , but It; does , not ippear that seg->. 
mental •ce|itr'a1 .Staff keep Conmtssion' 

of these plans. In contrast to the carefully structured 'review;; . 
procedures, for o'ccupatioy^ progr;amsV it does not appear that 
the Community 0pl.lege central off i£e pi an^ of academi^;^ 

jprogram^ across campuses. 

Recommended Changev ^ ' Current procedures for review of occuptional 
programs should continue', but should be assessed for utility Jrv 
segmental progran^^ The Commission sjio'uld be' advised 

of the results of these rev'iews. ; Because of tfij|g.3pparehtl^^ 
ing riifibers of tr courses in the* colleges, . 

' the Community College central office should develop: 'procedures ;.. 
for Identifying possible issues' relating to academic programs . 
and for assessing these on a segpientwi^ basds. 

Procedures of ttae State- University . and/iColl^^^es: ^ 

Currently . The State University and Gol leges^; is presently .engaged \ . 
in a twb^ear s^tudy ^ teacher -education .to. examine the segmental ^ 
mission in this area, to review campus p-rograitfS;{?f^^^ 
" perspectTve, .and to; make recommendations^ (California 
/^tate UniV^ and toTtg^es, 1980A p. 80)^^-;:;^ ' 
: /mental |;eyie^ been Conducted; in the p|$!t^J although :wi th 

• somewha^:'1^3^frequehcy :t^ 
On a cp!j$inuing,^ less formal . basis » ffte seg^^^ 
examiriesT- the- expensive,, quantitatTve o^^ta ay:a{.ilabTe to i.lT for . : * 

* " a : and Bowen , f975 , : 




Recontnended Change . The Cal ifornia State University and Col 1 eges .■ 
should coritinue existing procedures, .adoptrprocedures for ide 
fyi'ng segmental issues that may require cross-xampus reviewi and «. .. . ; 
notify early the Commission and other, segments of prostJectiye'f'' -.r'^ 

•studies;;;^ ■■• ■ - : ' 'i./ : ■ ■. r '- i^ -: 

Univgrsity of Cal ifornia. Procedures ■, ; .. 

Currently . The University^ of California presentVy has engi heer-^^. 
ing' under study' in a cross^campUs review of existing programs. 
In an ear Tier study intrasegmental review of educ^^^^^ 
member review fcommitttee included representatives ffeom the. indepen- 
dent sectoy-^ the :State .Deparliment oi" Education, arid the State ■ ; ,. 
University and CdlTegfes (Chei t et a1 • ; " 1976^ v Simil ar intlr^seg- ■ 
mental reviews have been conducted since: about 1,974' ;( see. Lee and. 
Bpwen, 1975, pp. 52-53)1 Recently,' the; University of ^ C^^^ 
cenBl^l^ off ice -adppted formal pol icies/for^ ; idehtify^ing a^^^ 
ducting iritr4segmen1:al rev lews^C^^ ■ 

Recommended Change . The Univjersity. of: Ca/jii'Qrnia:^^ 
existing procedures, - and notify early the Commission /and cfther 
segments of .prospective studies.' An earlier yni vers ity study ■ 
of institutional prqcedufesL recommended 'the devel ppm^^^^^ 
mat ion for use across campus€t§^ to increase the util ity of institu- 
tional reviews (University of Cal iforni a, 1976 ,p. 19) .., W^ endorse 
thi s recommendat.ibn.y' The Commission recommended that the University 
"undertake. Jtiore systemwide eval uatohs'of specific program .areas" 
(Ca«Tifornia Postsecohdary Education Commission, 1978B, P- 24) » , 
suggesting that they be as frequent as resources mi ght al 1 ow . 
Such reviews are useful, but their frequency should be determined 
: by the ne^ed to decide substantial segmshlal issues, not by resouir-ce • 
avai 1 abi 1 i ty . The cost -^i n i time arid disrupted . rel atiohshi ps may V 
be greater than the dollar ;cost "of the review. 
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Insti tuti bnal .Revi ews of ^ sti ng Programs 



Most in|.tt^ut^(J?ial r% of existing prqgragis are of two gen 

, i. Individual pi^ograjns^^or prbgraim a^^ reviewed ^nteji- ^ : 

■ styely^by^^ improvement;;, r-^ \ v.^ 

; .> In th6 State^ U^^^^ institutipns mus : > ^ I 

% ^; r every five years and the suf^l^riArelults - ; 

^ ctrd^reported to the central, office and the governingSq^rc^?.^^^ ' 
. ■(Califorrfi a state University arid Colleges, In /^^^ ^ 

V ^qiversity. of Cali-6)rhta, campuses s^ their ow 



^^ • forvrevieWs, /and programs are rev^wed on f ive to seven^ W ; 
; ^ r%cl es j( Uni yer si ty of Cal i i a /^^^975; ' Smi t h , S . ,> ^ ^.-^ ^ 



if 1979)r:'0LHr most recent information about^;the Cbrranunity :^ V 

; Colleges: ii that 33 of them reiitilarly-gg^edule rev^ie 

.; ' academ^H programs and; that 50 schedul e^ reviews of occupar;: : ^ . / 

- a tion^l ones :(California Po^tsecOtjdary^^^ Coinmission, - ^ 



^> Administrators of an insti tuti on^ive S:omevre>new "anr^ 

to all^programs, orTmarilx as part of institutional budget '/^^^^ V ; 
\ prcrtedures. The nature and extent ofjsuch' review vjarieis; ^ 
widely among the fhstitutibns and acrofss the s 
: and Glerin^, 1980). 



■ This report relies heavily. oh &tate and segmental progra^gi planning 
; and reytew to iassure that California' s edu&itional needs are^eti 
over the next decade. ..But this reliance will be misplace4 unless 
State arid segmental procedures have a firm foundation in effective 
institutional program 'Vlannihg a review. In our earlier report, 
wevurgejd annual "honest assessment of program^' quality, priorities, 
: and: staff ing"; (fiolwen. arid Glenny, 1980, p;. 61) . Such a^ssessments 



are critical If state -and ^efpientlil program plans, are. to be more 
thin paper exercises^ ' The type of. assessments that we urge 
recjuirg's a departure frpm" past practice in that it falls in'; 
^between the two hi stori cal patterns of i nsti tuti ona^. review of * 
. existing programs, v It cannot be is protracted,, detailed, and, 
; comprehensive'' 95 ii^cijl ty reviews ijritendecbto improve quality, 
but ife must be more than an annual attempt by administrators to 
keep the booses ,in balance and. to assure that Current .faculty and,, 
staff .Jceep their. jobs. Each'^nstitutt^n mus« deve.l.pp,HsVown .v, 
.-- : uni q ue procedure? for" spl vi ng the bas i c projil em" of gi vi ng. program- 
: .matic i ssues.' ancL pritjarities al dominant position, in annual re--, 
spufc'e allocationsprocesses. The task is difficult, and it is 
: encour*agTng .to |iave evid^ «that%Ome are performing it (e,g., • 
:',Stiffv- ■ ■ ' ' 



TheVse^ents'- can. aVsure that certain fundamental procedural safe- 
* , guards.-are ppdvided where, for example-, program' termination ^or ^ .. . . 

^ consolidation, may rW^^ from reviews (Saxon, 1979; Dumke^ 1979)^. 
; : But they should not -?r'and thus far,; h^ve not — .attempted to i 
^ ■ impose detail ed an^. unif orm procedures.^n, t^^ nsti tuti ons . In ^ 
' this regard the CommunityAlSbl lege central offic| should probably-' . ' 
PxtPnd its Program . Adirti iffs^rative>1^eview activities (California 
V • ..■ obtaining assurance . that the dis- 

V trigts and.xoTl eges are adopti ng ^propri ate procedures.^: . \^ ^ - . 
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RECOMMENDATION 7. THE COMMISSION, IN COOPERATION WITH THE SEGMENTAL 
CENTRAL OFFICES, SHOULD DEVELOP ^PROCEDURES FOR. IDENTIFYING AND 
REV I EWING EX ISTING PROGRAMS THAT PRESENT MAJOR STATEWI DE AND ' " 
INTERSEGMENTAL ISSUES. . " .° 

■ '■. ■ • ■ '. ' ' - •* ; , ■ :'■■*■'; 7 

. ■ •■ ■ V, ■ • ' - . . • • * 

As the, need is perceived^ the Commission should continue to examine 
statewide concerns, that are not relatied to individual academic 
or 6c(^pptiona'l ..programs. It should also develop relatively 
format procedures, .for .identifying statewide issues that are 
program specif ic apd that may require review across segmental 
boundaries. At a minimum, such procedures should: 

0 be developed in close cooperation with the segmental central 
\ , offices-;' .■ ' ■ " 

0 define with nsasonable specificity the state-level issues 
..that might require a review of ektsting programs across 

■^■u'^l^ents; ^ ' 

• ' V • ■ ■ • ■■ ■ ■ ^ • 

' • ■JT- ■ ■ . , . ' ■ ■ 

.0 provide a tontext n'^ withi a segments might ^ . 

■ be. identified for' possible segmental review across campuses. 

The* CommissiSn shduld encourage the use of the Intersegmental 
Program Review Council (IPRC) as a forum for Commission and. seg- 
merjtal central staff to share experiences and 'insights. 

DiscugsTon ■ v 

^Thls recdnHnendatlon addresses the role of the Corrtnission in- the 
J conduct of "multi-institutional program evaluatiotis for purposes 
of reflecting statewide rather th&n institution-specific problems 
or concerns". (Smithy O.K. ,1980^^ p- .45). \ Recommendation 6 concerrfs. 



the segmental role; in such evaluations. At the Commission level," 
statewide concerns appear i a at least two forms: 

0 'nonprogrammatiG concerns that ^arisefr or other ^ 

policy sources, but -thai} do/ not relate to specific disciplines 
• . or instructional programs'; " m , ^ ,. 

■ 0 prograrnnatic concerns that relate to specific instructional 
disciplines or prb^ams — issues of '^differentiation of 
function, for example, arising between segment's. 

*"..■.-" . .'. r , '. ' • ■ / 

The authority 'to . evaluate existing programs i explicit in Vuch 
areas as manpower supply and demand; or adul t and T:ontimiing educa-' 
tion, anti implicit in the, statutory permission to "undertake such 
other, functions and responsibflitfes as are. coijipatible with its 
role as the statewide postsecondary education planning and coordi-. 
nating igency" (Education Code, Sec. 6'6903). The same code section 
requires the Gommission to schedule "segmental review of selected' 
educational programs." ■ ... 

: ''S : : y' : [ 1,:^ " .. ■ ^ ' :■: 

Currently . The, Commission has "undertaken a number of valuable 
studies across the segmerrts in policy areas which do not relate ;. 
to. specific instructional programs or disciplines — e.g., tuition, 
coTlege-goirig; rates,, off-campus instruction, etc. (California . 
Postsecondary Education Commission.^ 1978A; 1980B; 1980F), It' has ' 
not, however,: as yet, reviewed disciplinary areas or specific 
/programs, as ;,>f or example, did the Commission's predecessor in 
'"'a^'tfudy of engineef;ing (Terman, 1968).: ' j^^i ;]^ 

In its first Five^YearvP l-an, the Commission found that because 
"of apparent tmbaTances/ in supply ^d demand: in the Anployment 
market, or because of ijgnificant flfl^nges ih professional require- 
ments or program devel opments,", the f iel ds .of teaclier educati on * 
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and the" health professions should be -studied on an .intersegmental 
basis (California Postsecondary Education Conmission, 1975, p- 63)- 
A study of the health professions was in process at that time V 
under a legislative mandate. The study of teacher education was 
delayed because/ of other Commission priorities, did not reach 
the prospectus stage until late 1978 (Cal ifornia'Postsecondary 
Education Corp/ssipn, 1978D), and was not undei»taken in the after- 
/math of Prop^ition 13. ^. . . 

.* The Comrt^sion w^s probably correcj. in 1975 in perceiving the ; 

. ^ need' for an intersegmental teacher. education study. Although 

an intersegmental study was not undertaken, the University of .. 
. Calif or n-fea completed its segmentwide review of education a year 
- later (Cheit, et. al 1976), and the Cal ifornia State University 
and Colleges is Qur rent ly engaged in such a review. 

/ In 1980,'v.ConiTitssion staff initil|M:ed distussion in the Interseg-^ 
.mental Program Review Council (IPRC\ aimed at determining appro- 
^ ^ priate instructional areas and procedures for intersegmental re- 
. views, but the discussions do not appear to be progressing with^,; 
much urgency. , ^^^^^^^ V 

> Recbmmended Change . The Coirjlnission should continue examTnatton 
of nonprogrammatic state concerns as.-the need arise? 
■ " -staff :^hQu1d also continue efforts to develop criiljeHa; for ;id^^ 

4 \^tifying instructional arejas which could raise stjcrte^: or 

r \ mental issues for possible review across segment^^^^^^ 
should proceed expeditiously. ; Both the Urii^ 
and^the California. State Univer^ and Colieges "have recently 
- ■ adopted policies fon consolidation, t^ ;pr othjer prtgr^ ^^.^^^^^^ 

>jv rnodlfi cat il^ns that may have imp! icati tin s.;;f M^^k' W^^ 

!■$ ■ of programs ,^acros$ segments . . It is: not t^eyp)id-^^ atton tHat - - 
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• H:- ' A :un&^erat . action by 6ne/,segnl^iit: Mnder. e- 
' ^ - ^ ^ H'afe to the Commission for respl lition. 



■'■^:p^!fri ^nd^'yJien; ;^ t;^^ 



: ^5\i:ti;2|ted::; 
^nd .:thei tiiinie^ 
idrnini: 




lrt^^Kne(iiiS^^^^i^? n$t4*at|onaT: ; ."^ 



•eA^ery ■ Cbp; 
? •sy^te#siiO!Jl.d.:^^^|f^ 



\}ey'ant heed for 



' prc^edur e^%;p." ^Stl so urge 



^o|^^^i5ati^rrt[;i^ejitj^ ; j' 



•■ ff»es^:re|^esentatives,;rta^ 
^' ■r*^v^^^)iper:ience/;that^^^^ 
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s t at^^yS^:: ;(»^^ i mp r e s;s1=ah 1 1 s t 



IPRC meetings are- characterized. . 
tiJ|a^ discussion,. an(y lack of directionl 

l^e^'^uip^roMS i'sisuefs a statewide ^ 

iari^^^^ would find, an appropriate forum ; 

iCV^- e^^ be identified with an immediate 

;;2Sf!;Jir:gVn^w issu^^^^ 



■Mai 



..^^"^^^ll^^x^ In segmental procedures might 



^.b||j&^^^^ We are xpbnstantly astonished 

"^'^ - "* S^r lof : admini strators who travel across the coun- 
earri whe^^^^^^^^ in other states 

Sin unfnfonried about those =i own. • 




re -the- prpgranr review' i^ of remedial educa- 

Howvpart;:^^^^^ of the Department of Education be 
J segment^? Who, if 

. * the; number and location of remedial .6clucation 

\' programs' >i>i California? What are the responsibwties, ^^|^ 
if aflfiy, of each public. . 



Is compettti on for students i ncreas i ng betweeh "the^ibl ic^ 

jigr^irt;/- 





le tri'depehd^^^ sectors? If soV what ..are the 
reyi.ew 'in|yiicatibhs of such competition? 



oT What vis' qT^:$h^ role of; accrt§di tuition .in progl^^ 

■ y^yjew?>"What ;has been the experience with segmental ob- 
- vv! serveri^ oft ' What/interest^ 

: : ^ if ariy;^^^.-^^^^^ segments have in a proposed inajor . 

■ V .^tud^: of;^^^^ arid : two year col l ege planning ;(Swensori,> 

* l;98Qrh:^^^^ the experience of the State/University^, ■ 

:;:v»aha^ San Bernardino campus, in the use of accredi-- \ 

tatT^ as outside reviewers iri periodic review of ^ ■ 

^V'^'fexisting^:^^^ ; : 
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t) What .criteria di fferentiate the functions of ■similarly 
■; • * v V titlgcp|rdgr^^ How ,,is~a certtficate , 

i: ■■ (^itm \n a tommunity college distinguished from qhe with 
•^ ''^ "; *the "s^^ by University of California extensibn? 

'^]'- / Or 'M'dentical" professional masterVs degr 

two four -year segments?- . .:> 

: *: The potential for I PRC becoming a major asset to the Commission 
and to i ts members i s great. Onl y more effort woul d be required ^ 
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RECOMMENDAnoiTs: IN COOPEfi^TlON Wn^^^ COMMISSION, EACH SfG^l:,, 
f MEjfr SHOULD DEVELOP PROCEDURES FOR, ^ AND CONDUCT, ANNUAUREVIEWS ' 
OF A SMALL NUMBER OF PROGRAMS NEWLY ESTABLISHED WITHIN THE PRIOR ■ 
THREE TO FIVE .YE;ftRS. ' 

Tfie segmental central offices are responsible, for implqmentati^^^^ 
of their own and institutional program plans,-" and shoula^develpp . 
procedures for assuring themselves and o'thers that their, responsi-; 
: btlities are being met. Annual institutional and segmental plan-' 
,ning processes that relate existing and projected programs^to 
institutional and segmental Emissions and objectives should provide 
major assurance. More direct and specif ic assurance should be . . 
provided by segnental processes for examining a. limited number 
of recently established .programs. The following considerations 
are applicable to the development of such processes: . . 

■ 0 A small §yi»ber of newly establ ished programs should be :. ^ 
■.reviewed^. .'. '^ 

: 0 /Processes shou\<i||ie clqse cooperation; with ' 

••/■'•the Conimlssionv':/">-"^ ^ 

. . 0 Two or three progrcmS^, at least, should ^ randomly V > 
* ' selected for review. ' > : 

0 Processes shoul d be^ consi stent wi th and. (if possi bl e) , . . 
i ; reinforce ongoing institutional : programs review... • - ^ 

Reviews of ^newly . establ ished progr^ be based on orig.- ■ 

inal- projections and pr'oposal Sj^^^o original planning assumptions, 
on relevant changed conditions, and on such additional quantitative 
and qualitative information as the Commission arid the seginental 
central offices may determine. . ^ 



Discussion . : • ^ V- 

! This recoiwnen^tTon^f^ newly established programs is . 

^for a^nec^ssary^6^i4ge; between state and ^egmerftal. program plans : 

. Internal, institutional ■ : 
r&)fieii4i^ 'exi st inf'^^gr^^ : may or^.m^ not ■ tie thei r f indi ngs / 
to 'State/ and\^eg^^ important 

* aim is to acceptva pVogram as it is found and to propose improventent; 

;;'State or;:segmentat/)^views of -existing programs across rnstTtutions 
are major ehterpri'se^^ a newly 

established program. Institutions, should be accountable foirv the 
irr^lemerr^^ of their plans, and the segments' for implementation / 
of theirs. Such accbuntabil ity requires informa^^^^ ; 
procedures: '"do, not ■prpyide. . , , -.v'';.''^' 

Currer^^ nor the segmental cfentraT .,^ " 

offices now examine the success of newly e$ta^^^^^ 
. It. is assumerf that hew programs are iestabl i shed as proposed 
to become regul ar parts of curricul a : - In .t]ie normal course .of , }_ 
Events, in the f bur-year "^^^^^^^ at least, newly established 

programs are subject: to I within about five to seven - 

years under procedures for routine, -periodic^ ';r^^ existing 
programs. But review fijidingi ;are; ay^ % 
segmental central staff only ih^highl formV: : ' /c ; 

Apparent lack of concern about newly establis^^ programs ntay ^ 
,be partly guistif led by current requirements for Commi^on, and 
segmental review of all deta i 1 ed proposal s for new pro grains • the 
effort expended in preparing such proposal s may assure establish- 
: ment as proposed. Nevertheless, cbn^^^ 

proposal is,.l Ittle guarantee that projected 'enroljments wil 1 be 
real i zed , that ant i c'i pated fundi ng will be available, or that • 
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the program can adapt to other significahtirChanges that might 
require deviation frow, or' mqdtfi cation of ;t 
; \ assimiptions'^ . v. ; ■ :..[''' '■,■■.;.■ ' ■ a;:v: -..v '-^ .. 

, -J^:":': Reconmended Change This recommendatfon far post hod review of : 
H-- -'^-^ newly established .programs is 3^ accountability measure to assure 
^ both Commission and segmental Central offices that th^jr own pro- 
gram planning processes and those of the ijistituWons are mor^ . 
than bureaucratic busy work. We do not see these^^rev'iews as 
"audit" devices to tietect possible misrepresentation in original - 
proposal s W projections; neither pur experience , nor the interviews 
even hinted at misrepresentation. ^ The' problem addressed is the ^ 
risk; tnhererit in all new ventures r-. getting new 
' is not an exception to the rule: that nothing ever really. turns ; 

out as plannedi But with fundamental responsibilities for plan- 
: ■ nirig and. the imp1)0Tpentat^ Commission' and the seg- 

. mental central off ices ^^houTd. know how and why real ity deviates , * 
■ from plans/' This knowledge is particularly important because 
; newly^^stablished programs are at the leading edge of educational ^. 
■\ ;:-.change»;i:-" ; '^-^ '^ - ^ . 

. ;The prpcedures deyelope mesh with that 

- , . ; " parti ciifar segtnent Isy un^^^ and review processes . ■ 

; there^ IS* little logic in attempting, tb/ prescribe a uniform- proc^^^^ 
V dure .f^^ three, but four considerations^^ 

-^v-ali':-:--^^ '' -^^^^^^^ ' V'^. . 

■• : • •■ ■ -■ .7-^ ■ ■• ''-y-'^' ■'■■'■'^f^'B^^M:^^..^. ■■: -'-^ .• ■ . ■ - 

1/ Only a small number of ne^^^ ' 

^ ; ! reviewed^ in our; opinion;. . The useful Seii^^f: 

; such prograni$ would be far less Vthan; the cOst^?. • , 



Z^.Criteria for selecting' newly establis'^cl programs for r^ew* 
^, .•'will emerge as the segmental /Central off >ce^ begin developing 



8(j- 



procedure^ i n'^^GOoperati on th Commi ssi on staff , but the ,^ ; ^ >. . 
following should be bbrne ^in niindv ^. y;; * 

: • b " At^ ■ 

; / ^ random to^ij^^ i/istUutl^^ ,;tb GonjnJrSt^jon ;and :seg- 

; mental central off 1^ in: theniri^lementati^ 

vT^ of Institaitionat pr^jgram -pl airs. - . , . - 

0 Other prbgr^s may be reviewed , as -th^y^^^^^^^^ to current 
• ; pi annfng i ssues ~ e Ig^^ to /projections: of simil ar pro- 
. / ■ grams on c>ther campuses i : to enrpllment^^^ 

subject matter area,; etc. ^ ^ ' - V ^ : V 



o • The .programs from which seiectleh is made should be those 
K fiyr whtch either a program projection or. a detailed pro-' 
^ gram^'prpposal has been subject to comment; by^^the Gommlssion. 

.- .0 The cri ter*i,a;for se.1 ectlDn should be. widely understood 

, ^ ' V •al:^ in^titt3l;+ons; before the ■firs; t 'reviews' are -undertaken. J 

„ :i. In d^vel op.irig review procedures ,, segmental ^ central ofnices . 
■: shau^d tie responsive ; tp for criteria • 

fo»?^ sfelecttpn oil; prd^^rams.;;^^^ should be responsive also ; ; •. 
' . to; the (fommi^sion 's n&eris^f.or^in format ion —"quantitative, \ ' ... / 

and* qilalitative irelevant-to state program pi anning. ; 

"4 ^Commiss'4on?s.taff ;l^ould4>r6ba^^ be, asked; ,to - participate , . 

; di recti y i n.;lhe:; cdh'd^^ ewsf - They shoul d however , •. 

; be clo#ly ;conni:ted'^ the report jng and analysis of - . 



the results^', i^; 
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"Our present expectation of reyiews-bf newly 'estabi ashed ^^^^ 
is. that they should resemble current;, ^internetTi^ * 
:. reviews for the imprpvement af^ program .qua.l^^ ask^ s^uppl e^ > ;: 

. mentary questions based on (1) qrtgTnal .p^^ 

\ tions, and ^roject.ijonS^^d (2) chahges .i.rt relevant institutional*/ , 
and social condi ti'ons after' the ^ program wd^ e ished . ^ - r 

:Our conception of the form such: reviews-might take :is. not as v /^^^ 
strong as our conviction that some review-is required V^^^ 
J)rocedures:i^ht include, questfohnaires, for example^ or a^ brief / 

: visit ,and^.!^^ by >n informed segmental cental staff ^ ; . 

^ ^ tfi^ recommendation for reviews on; an^ahriual^basi^s one that 

; vsl^^^^ engrayed on ;itonei '.experience may show that."armua1 ^ 
reyfje^^^ are. top frequentw^^^^B neither the Comm:i:^sioh nor the- ^ . ^ - ' '^^^^^^ 
segnientaj cehtra^l - offices n^ know how new programs^ are ihiple-. \ 

r mented or what impact ;th^j(.: have on- 
e^re in operation. •This information is \ita1 to effective state ■ 
and segmental prograiti .planning and to. accountabil ity/for educa^. 
tional: objectives. ; ' <. ' 




: 9. ; THE,LEGISt^URE,3H0IJl^f Etl^ THE DIRECf^||^,.^ 
.^RELATIONSHIP BETWpN PRIOR: COMMUNltV fOULK^ 

APPROVAL OF DETAILED COURSE AND: PROGRAM .PROPOSALS ANCT SW^^ 

'■ ■ : '■■■fUNDINGv- V:;-:^ - : ;: ^ ; ■ • :. ' . ,■ .:,..:.r_ ■ "■ ■'^^i:'-.^''-::'':'^'^ 

: . , . The. Community Col lege /central oi^^^^i^^^^i^ 
; ' policy leadepship' of the di,5tri:^^p^^^gy^^^^ . ; ':/:- . / 

level . / It should have, at least as ;mucl|^^^H„^6^^ shaping . . , 
V- j segmental program planning aind: review ai't^^ University "of (:al>- • y 
•'•'■;.^<i f.ornia irjd the California State Umvers'ity arid Colleges./ We^^ % 

recommend ■ ■ ." ■■■/;^r' ' ■ ■ : 



jo^"* i^rogram-by-program, course-by- course, prior segmental cen-- 
■tral office approval" of all courses, and programs 'be elimi-. 
• ■-..'i nated as a condition of state i;unding. ' , 

^ 0 Administration, of the detail s of -state funding procedures- 

be separated from program pi ajini rig and program review , _ 
responsibilities. ^. ' . ' ,. v 

■i^- ■ If financial sanctions are retjuired to 'enfprce legislative 
■ ' - or segmental edScatiohal policies^/^hese sanctions hot be 
.> ' meas4jred-directly by the number pf ^students in courses or 
i.',;: V 'iprograms; found to violate such policies; . 



Discussion ./^ . ' 




-'^ '^he- ddnmunity College', central ; WiV!.c?^|hou1,d a .rflajor ral e ' . 
' ■•^ii^^te:S=is^^^^ ^ -y- 

polleg^s.'. I^et'forpance. c)f -;thris roTe is-frihibdted^^'the. ci^ 
: ohe-to-on^ rerltion^hi p' between .state f und:i ng and^afetai 1 ed rore- 
/° aud<t of *di strf ct and, col 1 ege 'offeV-.tp^ -ori. a course-^by-cour.H, 



p^f^ram-by-|3rogranj«'basi's.,;.,<^^^ ; . : , .• ^ . / , 



^' ^^Ji3 both of the four-year segments, procedures for review of pew 
^i^f^' \ pr^^ internal axiademic program pi 9 resource 

aTlocation considerati^^ 
/ jchange in the absence 'bf legislative mandates or Commission ' . 
•: requests basei3 on^u<;Ji -mandates .^..B.ut Community Ciijl lege program, 
r review proc^^ i^ d' creature of Tegislatiyf mahda^sl The 
questiort is not whether legislative mandates afe ''goooNi^ "bad 
:/ Rather, |t f$ whethejc:. enforcement of thepj^^ 




' office pre-aud5,f^i^bcei^l^^^^^ 
• far educational objedtives thrpiigh state ;^and 

planning. We do not believe "^lat it is<^ . 




^aqcpuntabi 
fe'gmentat 



^4 

Currently , The law^^dVides^^ shall not "be appor^ 

tipned to Vany community vcql lege^^d account of ttie atti^n- 

dande .of students enrt^ed ..in: commun credit programs 

on riolricredit courses urilfes.s th^ have been approved by ■ > 

the board of governor s^^CEducation^^ Sec^ 78412) . : > 



This relat|phship between state funding and the approval process " . 
* is dir^t. • Fun^s flqw to the colleges based on ^e^^>^^ daily 
atttendai|:e . ( ADA )^ for studentis^n' h courses . If the J^ur^es have 
been app^ved, funding - i^ allowed ^■ 
; ; w^^^^ sanction of reimburserr^t of state funds r 

i s^mposed. The^ommiini'ty CoTleg.e central off ire^ approve? courses. 
; iricnyidual.l^^ or as part, of credit- programs. Local goverrilng^ards 
; may '^dd or modi fy " courses- tn exi sting programs where ,4,addi ti dns ; • . 
dr m^tficati^ are-cDnsistent.with the objectives of a 'pmg^^^ 



Rrevi^^sly^ aporoved ^by the centra! off ice;. 



^ Differeftt^procedures have 'developed in. t/^^^ central 

office fbr'the approval -of credit /programs "and courses; and 
' v^. ndncredit and certain other, types of/ courses: (S.ee Appendix B) . . 

\d*edit program^ and Credit courses that are not part of programs 

- '^ •■' '^'V^ - ; ''V:.'/' ^•';^^^;>/■;vV•: 



areVeviewed and eval uated, and approved programs are. fow 
ta„ihe Comnission for comment. Course approvals do not, go to 
the Comnission. If due allowance is made for differences ^'in size, 
mission, and concern with courses, this '^approval" proces^s ,is . 
^comparable to program review in the University of California and 
the' California State University and Colleges,.: ; Technical and Pe>^||g 
sonnel factors that reportedly caused protracted derays in thW-' ||;f^ 
past appear to have, been largely overcome. Under these procedur^'^ 
58 new 'credit programs and 71* Jew credit courses were approved 
fluring 1979 (California Community Col leges ^ 19806, p. 6). 

The app|Oval: process for noncredit courses d^^ in that it , 
requires substantially less exercise of independent judgment and 
discretion by 'segmental central staff. The process is essentially 
ione of reviewing a data cpl lection form and entering data into 
a computer^ed infbrmation systejn. The four-year segments do , 
'not have (Siparable review procedures. In 1978-79, 1,833 non- ^ 
credit courses were approved through, this process -- al.l_ ■subject 
to ADA funding (California CommunityVCOlleges, .1980A, p. 4)... > 

■ • • ' ' ■ , ■ • . ■ ' ■ " ■ ' - . ■ ■ • ■ . . ■ ' ■ 

The "approval " processes of the Community CoTlege central office 
should not be characterized as "rubber stamp" operations. They • 
are not. . They 'are the basis;for "acc|^ntabi1ity" Iri^^^ v ^ 

^strict and narrow: sen |e oi^.ithe term. ; K indiv-idual col1^^es^^(^^.^ 
. ate prograk or. courses thsrt jiave not iaeen "approv^,": and:|f|^ 
a Department, of Finance audit qf ADA catches 'them, substani^|pl 
financial penalties can be .imposed: ^But thi'S narrow purpbse^as : 
driven put the* possibil ity pf accountability, in the broader g^^^ 
of evaluation for jpurpoies of reaching and resolving state 
I segiiental educatiohal i ssues . Current procedures cahnot ad^ss 
major, concerns raised by. the changing role of the two year ■cbUeges, 
particularly In an'era_ of 'sustained fiscal ;and enrol Imenti stress.. 
For ex.ample: . ■ ? 
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J . 0 .Most of today's community colleges students take' courses, 

' . Wjiiare told, not programs that l#ad to. certificates or de- 

. grees/ They ar^e more, interested in specific vocational , 

avocational , or academicVsubjects t.han^ in credentials. • 
^Courses may require greater attention than programs in the 
future — perhaps they may at ^present . The current course 
* .inventory information base and the developing course classi- 
fication system (California Community^' Col leges, 1979-80) 
are valuable aricl necessary fir^ steps, but. only first 
y ; , st^ps,^ t^^ accountability. 

"6 The two four -year segments ^lave accepted the idea that some 
7 : V , expensive, low enrollment programs must be restricted to 
; v . - specific campuses. In the community colleges, however, 

K\ the belief still seems .to be that every student should be 

> : .witriin confuting distance of any desired course. Although 

V : a rationale .for distribution of high cost programs was de- 

v^lopedi (Brpssman, 1976*),: it does not appear to have been 

t useld for review purposes/or made current (California Ppst- 
sei^pndary^'EducatiQn: Corm 1980A, . p. 16). 



J- 



^ 0 Wany sitatewide issues (e.gV, articulation .with^ the four- 
■ ' ^^ear segments; remedial education,. etc. ) cannot be raised. . 
by current, fragmented review arid; /: 
eyen to the extent that absence of st^te or segmenl^al p 
plans might %1 low. Her*e againVmorje spphi.^ticated course 
cl as siYi elision would be^ step forward. . ■ 

The Community Colle^ central office face^, as we have detailed 
elsewhere, greater difficulties .t^ the two four-year segmentsV^ 
in developing .effective program planning processes. Bui at pres- 
^ent, academic pi anningu at the segmental -level in the Comnunity, 
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/ Colleges is^v ani i t i s unTi keTy.; to improve 

•^^^wtong as- staf^activitfes and oi)jefitives are dominated by^the 
•>-^Siforiement 
- eve)ry prqgram and course. 



6 



Reconmended Change .. tWs rVcommefidation is for eTimination of. 
what we percefve to' begone of the'^major procedural barriers -to ' 
effea'tive program planning^ ift the Gommunity Co 1 leges. OuEi^Ven-; • 
ture tnto the 'thi cket ^f -Cotmyni ty Col 1 e'ge fi nance h|s taken us 
ortly so far, however^ It has hot enabled us to pcescribe much 
move thSnthl elimination of the mandated pre-audit barrier.' 



nat predict how current review proGedures would chahge if 
« the legislative mandate relating them to funding were removed. ^ 

Progrin reviews that: are presently comparable to those in the'. 
* four-year i segments. might be expected/to continue, but perhaps 
be reduced in number by limiting attention to college projectitfns 
and selected proposals (See Recoimiendation .4). • Course reviews . 
■ • on .an -individual basis Should probably-be el iminated (Hard eroad , 
'1975, p. 20). Qourses are important, but post-hoc review of 
. 'information derived from, the computerized inforirfation system and 
ordered by emerging course classifications, would be -more 
discriminating than current course-by-course reviews. 

A major question that arose in the interytews centered on the 
extent to ^J^ich individual districts ancl colleges would be re-, 
sponsibile for their educational missions in the absence of finan- 
% cial. sanctions directl> dependent on pre-aud'lt, 'program approval . 
Will the col leges- "run wild," a-s one- staff .member suggested? We 
do^not think^. OVerly; zealous -entrepreneur ship is unlikely 
., -to result in any. s.j^stantial misuse of funds. Not many.fund^ 
will be avail abld^lgp misuse: ^The segmental* central at ' 
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/; v ; ' '- '^ dtkc^our^^^ "tt 1 ;n t hal^ori seHs^ v is, 1 a c )si irig :'^rr',3^^ ro^ t > // ^ • r V 

have ^^^P^^rtf^^ of ^4:Hc^si ior^lexp^r-t : ' "-'-^ ^ ' 

ced *tM^fr^$^^ 



pri^te Scrt^ 



We 

lehced •tl' 




separ^dV^conceptuail^ 
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f''"'^^ 4 ' We ihsN^fBl^ direct! y:V:,esD0nMl3t^ ' ' 

. |^a..p^rcu1a)r :,tinie^^^What'><&|^ ^^Ppipl^. -state: ; 



bns ahjtjr; (?onsoLi da- 
|tenf(insF We mus|^''attenipt t^5.5.es^'thfe.|!|pH7^.-van^d^^ to. 



■ ■ imike cfbci slis f o*Mteai i .wi th -it" -1 Cii tin, 'i'97S p7 24 ):. 

^ ' of P^Sfi^^"^^'^ "il^if^i^^ ^^^^ ^ current] y 

■ '-^^^/a^ an • ad"hi)E;^::^rQ^ balls* lhese'.^r^qr/ 

' J - V- /':"^*men^ad;em not entirely wSrsted , ]>f dbiirse, but ■identify-. 

• i ; : and j^tatewf^jejssues in fhe at- ^ 

; .-^J^^^^^ P^^^'^ not'^easy Even with an 

.e^^^ of, p^per pirfl ingc — perhaps' because of it \' 

v^y. f; issues i'l^ overlooked^ Whether :|lTey have or not, it is cer- 
taf^^ shuffled were, prepared^hrough 

t he . cos t1 y * e^^^^^ onal f acul ty andradmi ni s trator s . 



•Urider the best of circumstances, the preparation of- a detailed. 
,prp0psil for a new program requires extenstve time ancl .effdi:t 
•tKat' is Oflly poorly evi denced by: documentation .? ■ Meeti ng state 
and' segmental *requirements for justificairion and information is • 
pnejf'ous and inhibits risk. The burden -sho.u Id be lightened and 
risk bf new ventures encoureiged by early . testing of summary pro- 
Oections. in plans against- both institutional missions and oper- 
at'jonal segmental urogram pi ans . Faculty energy shbul d\be re-. - 
serW^^oT'^hair primary interests _and obligation: the mainten- 
anfce and improveiflent of program quality. 

'our recommendations contemplate less' paperwork at the institu- 
tional level, but they also require greater accountability for 
educational objectives at §11 levels, state, segmental , campus, 
and district or college. , 

• 1. Institutional .mission, statements to guide program develop- 
ment advise segmental central offices and the Commission 
■ of the. precise,, programmatic expectations oi' .fnsjtlfe^ 
faculty and administrators (Recommendatipfi 2) V 

^ 2. Through institutional program 'pl ans, new programs are' pij^ 
jecte^ from two to. five years in advance of establishment, 
and, at that time, justified under institutional missions ^ 
(Recommendations 4 and 5).. 

3. In segmental program plans, the institutional projections 
. . ^are! consolidated and analyzed p terms of statewide- and 
' segmental concerns (Recgmraer#ition 1) . ' ^ 



4^ The Gomrnissipn integrates segm|#al prpgram plans to assure 
I consistency with state-1 eveV ob^ctives and concerns -. 
■ (Recommendation 3.). ^ • / ' : 



-,. . ; .nir ; . ■•• • • ■ • A.. ,,■ . V ■■■ ■• ■ ■ . ■ <? " 

T " 5. .At each JeveV, institutional , segmental ,jand state program 

' ^ pl ans are the w 

both' periodic, interriaf reviews and 
ones across institutions (Recqmmenja^^ 

&• Reviews of, newly establ i shed progra^^ 
; , compliance with' program pTarr^ 

/ • under current operating^ r'. 

^ 7. .Segmental, district, and college program planning^is encour- 

aged in the Community Icol leges by eliminating the, curr^nj^ 
direct "approval VAOA re^lat^ 

We s^ee at least two 'difficulties, in bXir almost total Veliance 
^ on state and segmental program; planning. First, although plans . 
arfd planners are moving, into the mainstream of governance and 
coordination^ they do so at a time when resource allocation is 
^n even higher admi ni strati v/ priority than jui the. past. -Theory 
• subordinates budgeting to planning and. program review, but .the 
urgency of many fiscal decisions makes subordination difficult : 
in practice. ' . ' v 

■ ■ ^' ■ ■ 

jj^jfafrand, successful , operational state' and ..segmental prpgram plans 
huire clearly defined institutional missions, and, equally 
fm{)ortant, rely on internal> institutional planning and, program : 
rey-iew jjrocessfes ihat rigorously and. honestly addresT"Curricular 



changen.n relation to these mi ssionlj^and to staffing patterns, ^ 
(Bowefi .arid Glenny, 1980) , CI arifi cation of ' institutioriaT missiong^,.^ 
is an. unavoidable responsibility of segmental central offices-.* %i f<$ 
At each institut'jjon, faculty leaders and "seni<3r administrators ■ 
must develop the necessary planning 'apd program review prQcedures. ^ 
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Hird decisibnS are reqiilred te maintain and imprbye educatibnal 
; qua! i ty i ri Ihe next /decacle, ^ut ' hard ' dfecvsi ons are ijbt' 1 i kely 
in; the': ab§:^i^f' ^procedural context designed for that purjwse. 
The contl)ctl!hiist'b^ flexible to encourage prompt 

and.infbitp|Sn^^ for quality can only be . 

achieved at the camBuSes. At the same tim^,, collective campus ; 
respqi^ses must W measured ag^ 

thatCjii^oss institutiprtar ^ / \ 

The SUIT' bf clear institutional missions processes: is the foun- 
da^ioh 'oh which state a planning must rest. It is ^ 

not yet fully °in place. InstTtutipnal fa'eulty-and senior -admin- 
istrators must start giving first priority to acadanic and, occupa- 
tional^^ :p^^^^^ them, and to their future— not 
tt) organizational survival and job security: State ahd- segmental 
administrators — and state executive and legislative officers 
and staff as well -- m6st real ize that "accountabil ity" in hi gfier 
education involves" more than- numbers. . If quality -is to be main- 
tained, educational accountability must be fbunded;on. qualitative 
judgments and expectatilpns at campuses and colleges, and made 
r explici t "in state and segmental -program plans. ; 



1 

^1 



.90 



89. 



/REFERENCES 
BIBLIOGRAPHY 



Auvil,'M;S. An Evaluation Study of thet OutGomes of Vocational . 
-Educcttion Special Projects . Sacramento; California Commun i ty ' 
Colleges and State Department of Education, '1980. 

Balderston, F.E.> Managing Today' s .University . San Francisco: > 
; : Jossey-Bass, 1974.^ .* . ^ 

Barak. R>J.. A Survey of State-Level Academic Program ReView . . - 
Des -Moines, la.*^ Iowa State Board of Regents, 1975. 

Barak. R.J, State-Level Higher Education Program Review . 
Boulder: ^ SHEEfO/NCES Communication. Network, 1979. ' 

. ■. •# - . " , ^ ■-■ • . pt. • .■ 

Barak, R.J. Academic Program Review and Approval : Thr-eat , - 
Promise or Necessity? ; (Review Draft) Des Moines,.-Ia., 1980. - 

Barak, R.J. and Berdahl , R.O. State Level- Academic Program. Review 
in Higher Education. : Denver: Education Commission of States, 
, 1^78.^ : ;^ . ' '^^"^ . ■ / ■ , ■ .. 

Berdahl . R.O/ Statewide Coordthation of Higher. Educat/i on . . ^ 
• Washington, D.C.-: Aijieri can Council on; Education, 1971. 

Berdahl , R.O. "Problems in Evaluating Statewide Soairds." - In ^ 
Berdahl, R.O. (Ed.). Evaluating Statewide Boards . ^San- 
Francisco: Jpssey-Bass, 1975.;; / / 

Birch, G.E. ', "State Higher Education 'Agency Responsibil ity for the 
Evaluation and Accreditaiiion of Public Fourc-Year institutions 
of Higher Educ^iti on." VUnpubVi shed doctoral dissertation; 
University of Arizona, 1979. \ ; 

Bowen, F.M. "Dollar, Dollar, Who' Gets the PoTlar?: Making 
decisions in a Time of Fiscal Stringency." >In Lavin^ M.J. 

: (Ed.). On Target:- Key Issues of Region/ State, and giampus . 
Boulder: Western Interstate Commission, for Higher Education, . 
.1976. ^ . V: ... > . 'V- ; :^ ■ ;;; ' 

Bo^/eu, F..M,*\And Archibald, S.O. ^'University ;Budgeting in an Era 
/ ^ 'Of Scarce Resdurces." . InVMiclialak, Q.L^/(Ed.). Managing 
: tomorrow ' s Uni ver s i ty ^ Berkel eyi_4)h1 ver s 1 ty"rbf California 
• :Academic Business Officers, 1977. 



ERIC 



90 



ERIC 



Bowen^VMi' ar^ Gl^ t.A. Uncertainty in PubVifc tiigher ;;; • ; * 
V Education . Sacramento v Caltforni a Postsecondary Ec^^jcation , 
Conmisslon, 1980. \ . 

Brossman, S.'^Corre'spondence with McNeil, D.R. relating to -plan 

^ for highly spiecfali zed occupat1oha1/p Sacramento: 
- • Cal i f orni a Community Col leges , J uly 6, ■19,76. .. . ' ^ ; - 

ifjrnf a Community • Cnlledes;- Assessment jof XOPES ,.^ Sacramentof 
"Cal if orhia Community College^,. 197bA. ^ ■ ; 

" ■ . . ■ . . • ' ■ . • ■ ■ . ' .' ' . ■ ' ■ ■ . ■" ■ 

California Community no! leaes. CiaTif orni a Community Col 1 eges. . 
Five-Year Plan. 1976-1981 . Sacramento: Cal ifornia. Community 
Colleges, l!i/bB. - ^ : ! 

California rnmmimltv Coll eaes^ Program and C ourse Approval . 
Proc^edures. in California^go'imiunitv Colleges . Sacramento: 
California Community Col leges, 1977. i? . . 

U:^ifornta'"community Colleges. Lonl-ferm F inance Planly 
^ ^ecommfendattons for the 1980 Vs . Sacramento: . Cal i f or n \a 
: Community -Co I leges Board of Governors, 1979A. ^ 

r.^^^:nv■n^;, rnfiim.mitl*nn1 leaes.. -Mastei^Plan an d Inverytor'y 'df 
Programs . Sacramento: Chancellor' s Off ice, i979B. 

Cal if orriia Community Cbl 1 eges. :?'Annual Report: Program and 

Course Approvals'' (Preliminary. tiraft) Sacramento' iCaJifornia 

Community Colleges, 1980 A. " >. . • . 

Calif-ornia Community Colleges, "^lifornia Community Colleges: 
• Course and Program Approval I?i)ce5s.';' (Mimdo).; ^Sacramento: 
, .'. Cal ifornia Community Colleges, ^1^^^ - , ' ; ' 

Cal if orni a Conmunity Gbl 1 eges . " Program Adm i ni strati ve >Revi ew. 
- . , Sacramento: California Cb.mciunity Col leges, 1980C. 

• ■■ \- . ■ ■ . ' ■ : ^ : ■ • •. ■■ 

Cal if orni a PostseCondary Education Commission. A Five-Year Plan : 

for Po stsecotelarv' Eduction in California: 1976-81 .. .. ' 

Sacramento: California Postsecondary Educ-ation uommissign, • 

.•■1975.' . ... . ' : ■ "-.'.x \r - 

California Postsecondary' E/ducaW Commission. Plan^ninij f o>' , 
Pos tseoondarv Education in-.^ial4fornia:. A Five-Year Plan 
Update. 197 /-t'582 . .Sacrament California PostseGondary ; 
' Education commission, 1977;-^3V'''. ',; ' " : ; _ ; ' ' ' ;' V 



■ ■■■ ••■"4 Z'^'' 



91 



"J" V 



California ^ost secondary >EducatjQrt-icfi^^ a ; 

. Broader Context: ColTege^Goltg^^^^ California, ToySA, 



4 



Ca,1 if orn| a Post secondary, Educati on Commission^ * "Ani^ual Summary; of 
Rrogram^^Review Acrttvities."^ In Agenda ^ -Sacramento:,^ . 
Calif or'rti a. >.o5tseeondary Education Commission, NoyemBer 13, : 

■ . ! ' . ■• % ... ' ■ ■■ " , 



1978B* 



. Calif orni;a/Pdst secondary Education Cbmmission. Planning for 
/ Posisecondary Education; in Cal ifornia;, A Five-Year Plan 
Update; : 1979^ j^acramento: Cal ifornia yPostsecondary -Educati on 
' Commission, 1976c. - \: ^ 

Qal ifornia p'ostsecoridary Education Commissi on. "Teacher Education v 

in California.," Sacramento: California Postsecondat^ ■ , 
. Education CginmYs si on^- November 1978D, • . - 

California Postsecondary Education Commission,./ "Annual , Summary of 
Program Review Activities^ 1978-79." ' In Agenda. Sacramento: . 
.'California Postsecondary Education Commission, March 17 ^ 

■ ./ i:980A. ■• ' ■ ■ v_'^ -- . . • . ; : . 

' California F^stsec^ondarv Education Commission; Degrees^of , 

Pi versity: Of f-Cctmpus Educati onvin Californja . Sacramento: 
; . Cal i f orni a Postsecondary Educati on Cormi ssi on ,^ ,1 980^. 

.' ■ ■' . •. ■ ' , ' ' '■' i' ■ ' ' ' V • . ■ . : .■ ^^ 

California'Postsecondary EdUcati'On Comrtiission. Guide to . ; 
" California Colleges and UnisVersitiesV Sacramento: California;, 
Postsecondary .Ed^^ation Commission, 1980C. ' ; 

Californeia Postsedondary Education Cqpmission.; Issues in Planning^ , 

# for the ^Ei ghtjes . Sacramento: Cal if orni^a Postsecondary \ 
'Education Commission, 1980D*^ , « . . 

•Califorhia Postsecqndary Education Commission. '"Progress Report ... 
on Program Review Activ.i ties;" In Agenda . ^ Sacramento,: * / 

• • California Postsecondary M Commi-ssipn, October 20, " : 
1980E'. • ■■ .* ■■ . ■ ' ; / ■ . \ ■ ^ v. 

California Postse^copdary Education Commission; TOe Price of 

Admission:, An Assessment of the Impact of ' Student ^Charges on ^ 
. EiHrollments and Revenues In California Public 'Higher 
Educatiori ^ California Postsecopdary EdugatioTi Commission, 
^ ■ 1980F^ ■ .-y-^v^ - •. v-.,. v\ 



Xi 



EKLC 



f. • 



95- 



■f. ^, 



California State ngpai-tmeht of -EduGatibh^ " A 

Higher Education irt CaTiforni a v l960-19-75' . . Sacramento; - ' ■ -^o-'. ; ^ 
' • ^1 ifornta State :DepartTnent of Education, .1^0.;;; ! • ' 

Galji fornTa State Uni versj ty afld' epTl ege,s ;^ ' Report of the -Uroject. / >• ' ; , . 
; > Team on Academic Programs . -Long' Be^chi: ..Offi;Ge .of. . the '. . • 

Chartcel lor, 1979. : ^ ■ — 

■ :<-,■. V, •■/. •:• ,■ ■ : \ ■ , . .■ • 

' California State UniV^rsi'ty and; Col-lege§. Academi c Prbgranirajid. 7 -V 
. :Resource P1^^ning ih the'Califbrnia-jtate University and- ' 

Col leges. . LQng: Beach: Office of the Chancel lor, 1980Ai :. . ' •; 

>■ ■■ •, . -Z'^- ' 

^California State linivprsitv: and Cdl:leq^Sv^.> liata:^ ' ■ ^ 

^^Vs Discijlines, Fal V 1975 through l9:Hw ^Long^isppjupffice of .■ ; -If^^ 
P^/^thi^^han^^ ■- ■ 

l?{;elTif^rn1a%ate University, andlCoHeges. "Academi c PT^n^ing arid' '-^^ 7 - 
Myogram: Lbng, Beach.:.; .Agenda Item:.?, Board •of ■, *^Y' 

; ' ' Tr^ , ■ . i:^.)/* V ■ ; 'H^ 

Cal lari, P.M. - . 'lEyaluating. p by Statewide Boards.' U.n- ., , . , . 

.Berdahl i R. 0.. (Ed.):^ Evaluating Statewide Boards.^ > San ' .•^ ,•■ • 
'rPranciscb:^ Jossey^ass, .1975. , r ' : . ' .V;' ':^' ■ • • . •; ;\ - 



V? Callan, P..M. and Jorisen,^ R..W. "Trends^ # Statewide^Planning and> . ^ ; 
•rv. • •.tbbrdinati.on.''- In gduca-ti^nal Reco.rd . 'Summer -19B^ j >0-53> . • . ' 

• : ' Youth a. Better'iChanee . ■ San Franc isppr.^ J^osseyrBa^^; 1979.. . ..^ ^ 

.' ^;;jCheit , etV al iL Th^ Study of ;E^ucationV v -Bej^ley;^ ' 
■. -'v^v'"! California, 1976. .v ' ' \^ , / ■ ' ■ 

^•:; her i . and AnnliOv- Fk^:l !Supplemeht tb the' Handbook for ? >y ■ :. . 
; Institutional- Academfc-apd Program Planning . •BQuT'der:' • 

■ * Coons,' A.6. Crisis in ^cbl'ifornia Hit^her gducatioji . Lqs Angelas:. 

■ Ward-Ritchie,; 19.68^* ^■■ ;.;.,^'^;:,v.^. --^^.^^ ,-':;''"; ■ . ' ; '■'■■.;';■ 

-Craven,' fe.C. (Ed) . Acadefnic :PrQqi?am;i^|ii^tion : $ari Fraripfsco: 

■ • ■ : ■ ' Joss6y-Bass., 1980,<- - - . : ;':^-?,v;.^^^|; ,'; ■' ^ • - . • 

Dressel^ P.L, ' .Handbook of Acadgmic Eval'ciaM Frjtncisgo: 
'•;.•/ - Joissey-jBalss, ••1376*;;- ^- v • ; > .: 



■ > 



ERIC - V ^ ' 



Dumke, G A Memorandum td- Presidents: "In^^^ Policy for the • 
Discontinuance/qf Academ;ic Programs;*" Long^ Beach: Office of 
the Chancell or, Calii^ornia 5tate University and Colleges, 
January 25, 1979. " V ^ ^ • ' 

Education Commi ssion of the Spates I Coordinati c^n or Chaos ? 
Denver: EducatiQn Commission of the St ates^^ J^^^^^^^^ 



Educatron Commission of the Stjates." thai Teiige : ^fe^ihat i on and 
• Governance in the V80s . Denver: Education Commission- the . 
. States, 198a. ' : ' . -"^ ■ . / 

Elms, R.R. "Statewide Planniag and Program Review in Calii^ofhia%: 
Publ ic Higher* Education." • Unpubl islied doctoral dissertatign,^ 
Uhiversityvof California, Berkeley, 1980, ^ 

Etzioni, A. Modern Organizations , ^nglewood C,)^'ffs, N^J. 
Prenticg-Hall, Inc., 1964:, / \ 

G 1 enny , L . A • Autonomy of Public Colleges . 
: McGraw-Hill, 1959. - v 

Glenny, Ji. and Hurst, J. "Current Statewide Planning Str^ictures 
arid F\owers." In Glenny, L.A. and^Weathersby G.B. (Eds.J 
Statewide Planning for Postsecondary Edu,cation . Boulder: . 
Western Interstate Commission for Higher Education, 19.71. 




Glenny, L.A. , et. alJ State Budgeting for Higher Education:- Da^tnp 
Digest ! Berkeley: Center for Research and Development in 
Higher \EdLrcati on, 1975. V 

Glenny, L.Ai and Bowen, F.M. Signals for Change . Sacramento:.. 
California Posts.econdary Education Commission, 1980v 

Groves, R.'T* "Program Review in a Multi-Level State Governance , 

- System." Planning for Higher -Education , Fall 1979:, 1-9. ! 

^ ■ . .■ ■ , ■ . 

Harcleroad, F.F. Institutional Efficiency in State Systems of 
Higher Educgtibn . Washington^ D.C.:. American Association of 
State Colleges and Universities, 19Z5. 

^Harcl-eroad, F.F. "The Context of Academic Program Evaluation." 
In Cra\?en,. E.C. (Ed.). Academic: Program Evaluation . San 
"Francisco: Jossey-^Bass, 1980., 

Jencks, C, and Riesman, D. The Academic Revolution . Gardea^ 
City, N.Y.: Doubledayjc Company, 1968. ^ 



Jonsin, R. and Bassett, R, Postsecondary Education Program Review 
Boulder: Western Interstate Commission for Higher, Education, 



Kissler; CR.. "T-rends Affecting Undergraduate Educatl^ 

University of California." sPaper, prepared for-Board of v 
Regents., JJniversity of California, October 16^ i980V . 



4 



Lawrence, JVk. and Green, K.C. A Questiion of QuaTtty: .The. Higher 
' Education/Ratings Game , Washington, D.C.rX Wnerican. • . 
. ^Association for Higher Educatiorr, 1980. ■ 

' I ^ . ^ , ^ , ■ ■•■ y '■■U:y 

Lee, et. al. Admifii.strative Information SystienTs in thevUniverSity 
of California . BerkeTey: University of Calif orniaSystemwide 
Admi nitration, 19764^ ■ ^x' Y • 



Lee, E>C. and Bowen, F.M. Managing MuTtfcaiiipus' Systems. ^. San 
.Francisco: Jossey-Bass^ 1975. ' . 

t^rr, A.G., et. at. Systemwide Leadership . Berkeley:^ U'nivers1t)f 
Of California Systemwide'Administrationy 1977. ^ -* ' ;^ ' 

Marr,J\.G., memorandum "to Dwyer, H. "Schedule for Prqflram Review',". 

Office of Graduate Studies an3 Research, Uhiyersity of ^^^^ '^ 
• California, Davis,' Febrtfary 6% 1981. • ; . 

Mitlett, J .D.'^ "State Coordinating Boards and S1:atew,ide Governing 
•Boards." In-Befdahl, R.O. (E.d^- Evaluating Statewide 
Boards. Sa'n Francisco: Jossey-Bass, 1975. , • « 

-'i • • ■ , • 

Minglei J.R. "Influencing Academic' Outcomes: The Power and , 
Impact of Statewide, Program' Reviews-." v In Fincher;* Q. , et al. 
(Ms*). The Closing System of Academic Employment . > Atlanta: 
Southern Regional E^cati oh Board, 1978. v 

Morris, W.R. 'Tlow\*Chart for the Chancellor's Off! 

Implementation of the Evaluation Planning Process for 
Vocational Education in Commanity.CoTlege»s..." Sacramento: 
> Cal iforni a Communit/ Colleges, November 20j 1980. ' : 

.Mortimer, K. P. AccountabiTity in Higher Edu^^ation . Washington^ 
' r D.C.: ^-American. Association for Higher Education, 1972>. 

Nussbalim, T. : Education Code Mandates of the Board of Governors 
and Chancellor's Office . SaCT?'amento.: Cal^^ifornia Cortimunity 
Colleges, 1975A- '~ . ^ : ^ 



95 



Pal ol a , . E . G • et al . Higher Educatirfh l?y Design: The/Sociology 
« of Planning , Berkeley: Center for Res^rch and Deve;lopment ' 
• • 1 n -H i gher Educat i on , 197Ck / ' 



Rlfesman, D. 
: ^ 1980. 



On Higher Education , San Francisco: , Jossey-Bass,; 



A 



Saxon, D.S. Memorandiitto Chancellors: "Pol fey on ^ransfer. 
Consolidation, Disestablishment , arid Discpntinuano^of, 
.Academic Programs and Units." Berkeley: 0ffice\ of the 
.President, University of California, September 719, 1979, 

I • Saxon, -D.S. Memorandum to Chancellors: "UniversiT:y Program 
1 . Reviews." .Berkeley: Office of the P res i dent f?. September 17, . 

• . ' .-^ 1980. • . ' ' 

,' ;Sel T, R. "Relationship of 'Program Review and EvaTliation to ^ 
Academic Planning and Budgeting," Summary of discussion in 
Micek, S.S. (Ed,), Integrating Academic Plapnigg and 
/ Budgeting in a Rapidly Changing Environment . Boulder: 

.National Center for. Higher Education Management Systems, 1980. 

^ Shejrrifi^5, A,C, Memorandum to Presidents: ."Clarification of. 

» * Interilfi Policy >for DiscontinuanciB of Academic Programs," Long 
Beach: Office af the Chancellor, Ca11f*pr:nia State University 
and Colleges, June 12, 1980,. ' ' ; 

■ ^ Sftielser, N.J and. Almond G. (E(*s.). Public Higher: Edfucation in - 
Cal iforniW , Berkeley: University of f alifornijf Press, 1974, 

- / Smith, D^.K. "Academic Program Audit and Review^^ a Means of 

Allocation." Paper prepared for Education Commission 
■ -off the States seminar, Denvier, December 16*|l'975, 

■ ■ A ■■ . _ ^ ^ 

Smith, D.K. "Multi-Campus System Approaches to Academic Prggram 
- Evaluation," In Craven, E.G. (Ed,), Academic Program • 

. Evaluation San Francisco.:*f'Jossey-Bass., 1980. . 



V 



S;nith, S.S.' "Academtc Program Review: A Study of the Effects of 

Managerial Approaches on Hi ghet .Education," Unpublished 
• doctoral dissertation. University tff Cal ifornia,' Berkeley, 

1979. . V ■ ■ • ■ : ■ ^ / 



State of California,. Assembly, concurrent Resolution ^No, :149 i 
Sacramento : Cal i forni a. State Trembly, 1974*Stiff , R,", 
correspondence with Callan, P., re program review procifesses 
San Mateo County^dommunity (lollege District, December ;i9, 
1980. . 



in 



Swenson, R.E. Xorrespondence with Bowen,.F, , re propos-^L to the 
Fund\for^the- Imppovement of Pbstsecondary Education, to define 
roles of. state agencies anc^ accrediting association Ajf\ 
eve^^luation, January;25,'1981/ 

Terman, F.E. A Study of Engineering Education in Califorqia , ' 

Sacramento:. Coordinating- Council for Higher Education, March 
.". ■ .1968. ■ ^ ;;■ • ■■ -.J. ,-. ■• ' • • 

Thompsbn, F.' "lnformat|i on Systems for State^Level Decisions and 
the Budget." In eollie.V^', D.J. (Ed.). Innovations in higher 
Education- Management , . Boulder: National: , Center for Higher 
Educ^tidn ManagemeTit Systems, 1980. :4 . 

• v: ' ■ ^ : \ - i : / ' • . - V^ ^ ■ , ■ ^ 

University of Cal if orni a Academic Senate. ; ."Suidg;l in for 
: Proposals for New Deigrees and Programs." tfB^rkeley:' ' , 
Coordinating Coiknitfee on Graduate Affa,i:^s> Oj:tober 14, 1975A. 

University of 'Caltfornia Academic Senate.; "Report of the Special 
Comnvittee' o.n Long Range EducatibnaT::Objqc):iyes and Acadernic 
'P.lanninq-." In Notice of Meeting : ' Berkeley: Academic Senate, 
.■-May'29, 19758.'"^"^^ ~ T ■ ' ^- :4^' ' ' \ A--^-^ 

University of Califor'nia. Academic Progp^iri ReNiiew in thie 
- "Uni\^ersity of California. Berkeley.: Qi^fice Of the-Academic 
^ Vic^ President,.- |i976. 

UniversTty. of California. . "Report ron Administrative Information 
Systems." Berkeley: ^fice af the President ^ 19aOA. v : 

University of California, '"k^iew of "Existing Programs and ' 

• Organized Research Units, •1979-1980." Berkeley: Office of 
/ the Academic Vice President, 1980B. ' . ' 

University of Calfornia. Uaiversity Plaoning Statement*, 1980^ 
' (Draft, for Comment Only) Berkeley:- University 'of Cal ifor/iia, 

September 30, 1980C. 

r ■ " ■■'**■... ■ ■ 

University of Wisconsin System. "Summary of UWS Academic Program 
Audit ^nd Review." Madison:. Office of Academic Affairs, 

■;■ i977.\. ■ ■ . ^ 

University of ♦Wisconsin System: Academic Program Guidel ines . ' 
' Madispn: Office of Academi.c Affairs, 1978; 



ERIC 



• 97 



If: 



University of Wisc'Qnsin. - Preparing for a Decade of Enrollment 
' ^ . / pecTihe (and separate Appendices ). Madison: University of 
Wisconsin System, -1979. ; . ' - , 




>2> 



101 



; ■■■ ' ■ V. APEENDIX A , > " •. 

, ■•■ .I.;. ,• ';' ■". ' J.' ■ • . ■ _ ' ■ ■ . 

■,>R06RAM :REV.,I£W IN THE CALIfORNIA POSTSECONDARY EDUCATION COMMISSION 

The policies uflder which i:he California Postsecondary Education !. 
Commission. (CPEC) reviews pt'ograms are found in the 1974 legislation 
under-which CPEC replaced the former coordinating agency. Three/a . - 
legislative requirements' are '•particulcirly relevant (Educ. Cddev . 
ecf 22712):-. •^ . \ ^ '■" ■ ' ' ' ' ■ . ' ., 



1) /CPEC shall ^prepa£e five-year state pl^ns "which shall ^^ 
■\ ; Integrate the planning effqrts o,f -the public segr^.nts," .. 
' / and "shall, repuig^ the governing boards of the segrhents" 
. to deveTop and submit long-range plans. 

.2) CPEC sha]J; "revi ew pf oposal s ^ by the puffl f c segments for 
*^*new programs arid make recommendations regarding such 
-proposals to the Legislature and the Gdverhar." . 



3) " CPEC "^shSl 1 , tin consultation with t-he. public segments, 
. ^ establish a schedule for segmental review of selected 
. educatiotial p^^^ evakiate th^rogram^ rieview .pro- 

'cesses' of the segment^, and^ report; its findings and 
' recomrRieridattons to the Governor and Lis^gislature." 

Current CPEC planning arfd review (Drocedi^res aje set out r in "^^^^ 
Commi*ssiqn' s Rol^vin the Review of Academic andAOccupatidnal Plans 
and Program* Sf^9^ted by the Commission i n 1975 after consjul tat ion 
with the segments. - , : * ^ - ; ^ 

The 1975 guideline^ est|ibl1shed .the intersegmental ■^Pr'pgram Review 
Council (IRPCi, consisting of representatives from the three public 



segments, the Associatibh^pf Independent California Colleges and 
Universities -(AICCU)\ The CaliVorni^ Advisory^CouxiciT^oi^ 

• Education a^nd Technical Trai^n^, The Council for Private Post- 
■secondary Education, The Di^partment of Education, and CP EC staff* ^ 

• Under the guidelines,; IPR^was to advise CPEC sta^f on all matters 
relating toprogramrplannihg and^review. In practice, IPRC meets 
two or three' tiraes/a,,^arv<^ attendance is. g^^nerally limited to repre- 
sentatives 'of the tfifee.publia segments (and/perhaps -of AICCU) , arid 
the primary topics of advice hjive beerT CPEC staff's annual 'summaries" 
of segmental program review^actVvity. ^ ; ", < 

;• ^ . ■ • V '"^ . ' . ; ■■ ^- 

Major staff resportsibilityi fo program review in GPEC is with the 
Associate "Director, ►AcWemic- Affairs, and direct responsibil ity %s ' 

'with the' head of the Coordination and Review Section. The. head of 
the section and two oth^r professional sta-^members review new 
firogfam proposals. Approximately one-half the time of these three. 

'staff members is SReht on program, review -- approximat^ely six per- 
cent of to.tal administrative activity of/ CPEC professional, staff. 
Ipaddition to thedr prograui review responsiMl.tties, the three ■ 

.if aff members partitipate in special studies, pi anrw?^, and related 

•XPEG activities* . ^ f 



CPEC activity in this, area falls into thr^e relatively discrete, 
catagbries: (1) new program review (2)>^va.luation/of segmental 

procedures; arid (3) review of existing programs. 

■ ' " y; ' 

■ * ■ ' . ■ 'i}- ■ ' ' ■ 

■( • . ' . N I*. 

New Program Review * ;\'Q: 

Under the 1975 guidelines, the review; of new programs begrins with 

CPeC review of. five-year, segmental program projection^. As'. 



\ ^ - . . 

iginally contemplated^ CPEC-'Staff wou,"hd/ examine each new program, 

.projected, concentrating on (1) the. numl)er -and regional distribution 

of existing prograrps, (2) enrollment trends, ("3) job market . 

considerations, and (4) probable costs. Problem ai^as would be 

[ . . ^ 

identified — e.g., possible duplication — and. these problem ajaeas 

■ . • » ■• ■ • . ■* ' , • ■ ' ' ^ ■ " 

would be taken to IPRC for discussion and/resoVution. In 

consultation with IPRCVCPEC staff would also identify^specific 

programs in the five-year projections that were believed to requir'e 

furlher consideration by the institutions and segments .befdre formal 

proposals were submitted. ^PEC staff, wou^d' also identify/programs 

— ' including, but, not neqessarilyN^ited to the firs-^ group that 

would be subjectvtg "intensive review" by CPEC. Although CPEC 

reserved.the right^to review any new program, proposal , it was 

9ontemp1ated that only information copies of a proposal would be 

required for a program that had-'appeared on a segmental master plan- 

for two years pVtor to its intended establishment and- that- was not 

initially identified for intensive review. CPEC s first five-year 

plan in late 1975 listed. twelve program areas Tor which "additional . 

justificaticrn"\wpu1d be i«Sijuired. A far ^greater number of specific 

• programs were i dent iffe|l in a 1978 report in which, they were 
clas^Uii&d according tp the"reasons for* more intensive review. 

J\yk i dfentif^Ji:^^] on specif projected programs for intensive. 

review under the 197^, procedures has not operated aSlpVanned, in 
^ part because of the diSruptionlof segmental planning fol lowing the . 

adoptiW of Proposition 13.>* The current implications of the attempt . 
. to ic^enl^fy specific programs for review differ among the three 

segments;:^ . . ^ 

• . ' . ■ ' ■ . . . ■ . 

• . . ■ • , ■ ■ ■ ' • 

For CPEC review of Community College proposals, early iiientifi cation 
has had little, if any, -impact. Projections from indiyiclu-al colleges 



haV:,e been forwarded to CPEC without regard to schedule and without 
analysis, by 'the segmental central office. The problems of large 
numbers of projected programs was compounded by apparent un- 
reliability of the projections;— e.g., some programs already in 
operation were shown as pr.oj.ect^sdv During the. past two. years, CPEC 
staff has not reviewed projected program? of the Community College's 
because revised lists of projected programs were rtot provided. 
Individual program proposals .do indicate whether the program had 
been projected in Gollege plans/ 

For CPEC review of State University proposals; early identification 
has resulted in greater segmental attention to programs earlier 
designated for intensive review by CPEC, In .l5J8-79, the -St ate 
University suspended five-year program'projections in the face of 
uncertain funding, but resumed projection^ jn 1981 • ; \ ; 

For CPEC review Qf University proposals, the e^rly identification- 

procedures appear, to have resulted in more intensive review of 

, ' ■. " • * 

designated graduate programs by both-GREC and. segmental, staff • 

... ■ . ■ ■ '**'■■■'' ^ . . ' ' ■ ' » , 

Under the early identification procedures and as a*^ matter of policy 
' as these were suspl^ded; CPEC has jgenerally reviewed University and 

State-University proposals for new undergraduate programs. in detail 
•only when initial , informal discussions indicated that they might 

fall outside customary 1 iberal arts offerings. 

CPEC staff propose reinstating early /'^eview of projected program? in 
' segmental, plans; as conditions, permit. . Currently, however, the major 
activity of CPEC staff Is in review of ; new program proposals as 
these are received 'from the segments. 



Although each of the three professionals involved fs primarily 
responsible for all proposals from a particular segment, the review 
of new programs is a collaborative process. The proposals that CPEC 
review^follow guidelines issued in 1975 that prescribe both the 
information required in proposals and the principles under which 
Cr^EC staff review them. ' . 

' . ■ ■ . ♦ • ■ 

The six ^>ri nci pi es"' or cri teri a whi ch CPEC staff, use j n revi ewing 
new program proposals are: (1) student demand; (2) societal heeds 
i .e. educational values other 'than those based on labor- market 
estimates; (3) employment, prospects.; (4) existing and proposed^ ' 
programs in the field; (5) program costs; and (6) maintenance and 
improvement of quality. ' \ ^ . 

LfsingHhe six principles, a CPEC staff member prepares a written 
analysis of the proposal that, is reviewed b^ the head of the ^ 
Coordination and Review s'ection... If further information is not 
needed, the head of the: section will recommend either concurrence, 
concurri|nce with conditions, or nonconcurrence. Commission staff 
may take on of the following positions: (l)'Request additional 
information; (2) concur with the proposal ; (3) not concur with the ' 
proposal; (4) concur but with conditions. ■ In the, case of a proposal 
which the staff fiMs controv.ersial , the Director and Associate" 

Director, Academic Affairs., participate in the review. 

. ~'' ' t ■ 

' ' ' " ■ ' ■ ."■ . 

Virtually all differences between CPEC staff and segmental staff are 

resolved at staff level. If agreement cannot be reached at the 

staff level , the guidelines provide that either Commission or seg- 

■ ■ ■■• y ■ , ■ . ' ■• . 

mental staff may bring the issue to the full Cjommiss ion.. In rare 
instances, segnients have so apR|'?tled .a npnconcarrence comment (^.g. , 
a, cl assic$ program at a Univef-stty campus). - ■ 
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The l^a^ act'dn proposals for ;riew programs within 

60 days -of their recejpt. This time is ex-temJed by agreement if 
additional information or clar:jf icatioh is required CPEC staff try 
to complete their review^, within 30 d^ys. 

• ■ ■' * ■ "* ■ « * " ' • * ' .* , 

.Since 1976, CPEG has> been developing a computer f zed information 

system that prpvides' comparative data on enrollments and degre.es, 

general ly accoifiding to the HEGf5 tajconomy of disciplines for the 

three public segments 'and the independent sector, CPEC staff ^ 

, rout'inely' useMnformati on- from this data base and from .its annual 
Guide to California Colleges and Universities , which lists all 

. program offerings by campus,"^ - ' ^ 



Evaluation oi^ Segmental Program Review'Procedures ^ 
; In 1976, after consultation with segmental staff , CPEC undertook .a 
• survey of institutional program review procedures, inquiring about 
both the nature of procedures generally and all reviews conducted of 
existing programs durtng the partlxiular year. The respohses^o. the 
quest ibnnairft survey were foiind to be ,bf little use because ^of lack 
of comparability, and the results were.pot published. In addition, 
to the comparability problem,; only about^ one-half of the community 
^colleges responded to the survey.. , 

Since the 197^ survey, CPEC has not formally evaluated segmental 
V procedures,, but has tommented on these ifi. the annual staff reports 
- on segmental program review activity. For; ex^mpl e,, in the'1978 
report, CPEC staff suggested that the Chancellor* s Office-of the - 
xCom'munjty Colleges develop guidelines for college review of existing' 
programs,; that the gniverslty's Systemwide Administration undertake 
more systemwide evjiluati oris of specif ic program areas, .and that the. 
procedures in the State University give greater emphasis to the 
possible ^erminatTon of prog^^ as a consequence of campus revjew. 
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In 1980,' indepenctent contractors wef^e Gomm^^ CPEC^to 
evaluat^ segmental procedures >as w^ll as those ^f C PE^ itself, 

Revi ew of Exi st i ng Programs ^ .-x " , * ^ : 

The legal requireme1*^that CPEC '^e for segmental 

review of selected edticalbionaT programs''* ^^^h been interpreted to 
authorize ePEC" staff coorcjiha^^^^^^^ reviews*. The commission' 

^ first five-year plan 1ndii:ated that GPEG staff woutcl undertake a 
"comprehensive .segmerjtaT review" -of teacheri education programs. 
Lack of staff initially •'delayed the proposed. review. In 1978, a . 
prospectus was prepared, but priorities associated with response to 
Proposition 13 then intervened. As a result,. CPEC has not yet 
undertaken an intersegmentaT review. CurrentTy, CPEC staff have - 
initiated discussions through IPRC to determine areas of -statewide 
and intersegmental concern, in which coordinated .intersegmental 
program reviews WPtild be considered appropriated 
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PROGRAM REVIEW IN THE CALIFORNIA eeMMUNITY'XOLLEGES 



C eeM^NITY^( 



The Board of Governors of thecal ifornia Community Colleges^ jfe a 
cdot^1nat1ng agency rather^h'an a governing boar^. 'It prepares' > 
five-year pl-ans, but pel 1c1es and procedures for program. re\nNBW have 
developed 1n r^ponse to stat^ and/federalvl egi slat 1ve requirements 
rather than the planning process. Three such requirements 
predominate: . ^ " - < 

f 1) . State law conditions state support of programs and courses 

on their approval by the Chancellor's Office. 

* . . .. ■ , " 

■ - ■ . ■ • 7 ' ' ' ' ' . ■ ' ' ' 

- 2) State law requires that all new programs be/rev^lewed by 

CPEC/ the state higher education agency. " ' * 

3) Federal "law conditions, federal support of ce^ain . 
^ ^ occupational programs on evaluation oT these programs. - ^- 

Respons'ibility for program review in the board' s. central off ice, the 
Chancellor's" Office, is. one of several major responsibilities of the 
Executive Vice Chancellor. Direct responsibility for review Is with 
the Admisnistrator, Program Evaluation an(^ Approval , whose office 
(Program Review) cons:ists of approximately ten professional staff- 
members. It is estimated that some 17 percent of total, administra- 
tive activity in the Chancellor's Office is in four types of program 
review activity: (1) new program and course apprroyal ; (2) non- 
credit course approval ; (3) indiependent study course approval and 
(4) approved course inventory file and the invenliory of approved 
programs. -Program Evaluation staff, in addition" to performing these 
reljrtively. discrete functions, serve as program specialists to 



a'ssist colleges and are responsible for evaluation |nd iTidnitoring 
systems for primarily --occupational programs. ;/ . 

Although currently under revi si on\ Program and Course Approval 
^ Procedures in Cjl/iforni a Community Colleges (April. 1977) is ^' 
' subitantiaUy achate in'* describing^curreht Chancenpr's Office 

program review, act ivi'ty and requirements. - 

, New Program Review ^— Credit Programs and^^ourses • ' 
The bulk of program review activity in^ the Program Evaluation office 
. 4 nvblves district -iTT^Jpo^ for (l).new pmgt^s for credit and (2) 
new' Courses fOr credit when t^iese courses <ire not-part of existing 
^programs. Colleges Submit "academic master planV a'r\nualTy tb the 
Chancellor's .Office that project 'program offerings 'forv the next fiv# 
% years. ; These projections are transmitted to "CP EC by the Program 

Evaluation office. . . . 

■ - ■ ■ . ' . ■ 

Currently, it does not appear that college program projection^ ' ' 
receive significant analysis eit-hervby Program Evaluation or by 
CPEC. As a tesult of an extensive study of long-term financial 
i,ssues.,howeyer, the Board of Governors Vis exploring .nev/ procedures 
that would emphasize analysis^of projected programs and. reduce, or 
eliminate current reliaRce on cour'se-by-course and program-by- 
program approval. 

■ ■ • * ■ ■ • ' * ' . ■ ■ . 

Colleges use local procedures for developing. new proposals which 
they submit on an a.pplication form prescribed by the Program Evalua- 
tion office'. The form is* detailed and requires all information that 
'CPEC requests for review as Well as information relating to inter- 
ests Of the Chancellor's Office. In the ProgramEvaluat^i on office, 
the staff member responsible for new. program'^nd course approval in- 
itially determines if the proposal is complete,* and then distributes 
it for three types of analyses* , 



1) A disciplinary specialist reviews the proposal from the ^ 
curri^cular perspective, prepares 'a -suqunary — usually very 
brief -r of th.e proposal, and recommends approval or 
cfisapproval J, The Program Evalulition office has specialists 
in such -l^reas as n||mral sciences, agriculture, business * 

. education, etc. Staff members usually are special ists in 
^ more than one area. . • . ' ^ 

2) A manjDowen special^ the jot^^market analj^s ^'{^ 
proposal i and if-'^necessary^ updates tiie jitsti ar C 
acquires addttiofiaVinformatj on from'the college. 

3) A facilities planning speciaTlst reviews the proposal from 
the point of vi'ew of the impact of the proposed program on 

colleges physical facilities. " , 
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Th'e staff member responsible for approval again reviews the\proposal' 
and the analyses of the specialists, and recommends' either approval 
or.disapprovail to the head of Program Evaluation. If the latter 
approves*, the cotnpletg^ proposal andvthe Program Evaluation analyses. 
are> forwarded to CPEC for review and comment.; . . , ' 

Program- Evaluation staff attempt .to have propbsaTs prbcessfed within^ 
the. Chancellor's Office- and through CPEC Wit'hin 90 days, assuming 
that additional consultatioh with the colleges is npt required. In 
general about ond-fourth of all programs proposals and orl'e-t hi rd of 
all course-proposals require such cdnsuTtati.on. In 1978j* Program • 
Evaluation approved 63 programs and 252 courses. In*1979, 58 pro- 
grams arid 71 courses were approved. The number of disapproval s or 
withdrawals is not known. ~ 



Approval of courses for credit generally parallels approval of ; 
programs for credit , with the ;exce^ion that coursfes are not ^ 
transmitted to CPEC -for review and Oypmment. Criteria for review of 
courses includes examining the releve^e of, the.proppsed course to 
related, existing programs, and in some casesV Program Evalu^i on 
staff recommend to the> col lege that the course be included with'tn an 
approved, existing program, ' / ;( ' ^ ' ' ■ 




Quantitative information on state and i;;egional mafipower needs lis 
routiriely used in Program Evaluation staff review of credi^ programs 
"If^courses. Quaftt it at ive information relatlTig^to instruction 
(e.g., 'enrollment projections, student/faculty ratios.,^ etc.) is 
•lotally clevelopfid for the proposals by the college.s. Thef^progr^ 
Evaluation Office rarely compares quant rtcitiv'^ data relating 
instruction (e.g., s^tudent/f acuity ratios; productivity data, etc-) 
for oney:olleg^ withl that for other colleges in reviewing' proposal s 
for^ew programs and vcourses. 

Implementation of new programs .and pourses is'mopitored as'part of 

■ • ■ ■ ■ * ' .■t-*'. ■ .. . . . .^^ . . 

Program Administrative Review. Once^a program is .approved, the « 

local governing board has author/ty to modify courses within the 

program. The Program*EvaluatiOyn office uses Identical forms for the 

approval of two distinct types of instruction: , 

1) Noncredit courses are (a.) those offered as part of the 
' : community services function of a col lege, and (b) those for 
education of adults. In 1978, approximately two-thijfeis of 
the noncredit courses were elijgible for state support — 
i .e;^ , 4,142 courses but of a total of 6, 270. Funding was 
.. allowed for all noncredit courses for 1979-^80 and 1980-81. 



' . 2) Independent study courses a-re approved, under legislation 
permitting state funding for courses of instruction ev§fi 
though an accredited. instructor Js not' present e.g., a 
• learning laboratory;, a self-paced, computerized'^rogram; TV 
course, etc. . . ■ ^ w ^ 

Noncredit and independent study courses are submitted for approval 
.on a single page "course reporting andv data coll e^i on" .form pre-, 
scribed by the Chancellor' sS^ffice, The form requiS^es,. of course^ 

d1stfnct>oh. between noncredit ajpd independent study courses, and 

completion requires follovfing, some 28. pages of detailed instruc- 
"tions. Th^ complet^'d #orm allows; computer compilation 6 
substantial amount of information .about the course-- e.g., nature 
of justification of pragram need; course objectives, etc. ' 

i^ljlte/^^^ .in the Prdgran^valuartioh office h|^ P^^"'^!^ ^^spon-* 

sibility for reviewing eacK^new; noncredit and i Ddependen:^tudy ^ 
course proposal for completeness anct internal consistency.*^ After 
consulting with, the college, if this Is required*,, the responsible 
staff member ha? the course entej?ed intg the information system, v 
Entry in the information system constitutes approval that 'continues 
until th^CQllege notifies Program Evaluation that the. course is no 
longer: of fibred or until, routine data collection in the course activ- 
ities meas'lire indicates that it has not been offered for thr^e 

'/Consecutive years. • ' r 

Review of Existing Programs ^ 

State law requires that the Chancel 1 or' s;^ Office monitor credit pro- 
grams on a periodic b^sis and that program approval be withdrawn if 
it n*s found that a program should longer be offered. . Withdrawal 
of approval would disallow s^ate funding for the program. The 
Chancellor's Office has not yet developed specific procedures for . 



such monitoring but doe$ engage in .five somewhat related monitoriiig 
or evaulation activities of which PAR is considered relevant to the 
state mandate:* - . ^ 

1) The Community College dccupational Programs Evaulation : 
Sj^stem (COPES) is the reSuU of about ten years*" study and 
voluntary use by some colleges. Essentially, it requires a 
college to undertake a broadly based self-study which is 
then reviewed by a visiting team of outside experts -from 
other colleges whOj have been jtrained for this purpose. In 
/ 1979-80, th| ChincellorTs Office initiated a four-year pro- 
ject under which all colleges and all ^occupational programs 
\ will .be^evaluated under COPES proGgdures -- one fourth of^'^* 

the colleges and one fourth of the programs -^each year. 

i ■ ... ■ ■ 

\Tr The student Accountability Model (SAM) provides information 
required for compliance with federal vocational education' 
regulc^tions with respect to employer evaluation o^ occupa- 
■ Ji tibnal programs.. SAMn's part of the ^qur-year projet" 

. . 3) A longitudinal study of both occupational and'nonoccupa- 
.tional programs was started in 1978. for 15 colleges. The 
study, is jointly sponsored by the Chancellor's Office ^nd ' 
the.State Advisory Commission, on Vocatlgnal Education. For-, 
the Qop^^ concernegl, this 1 ongitudinaT. study is. also part 
of the "fp^^^ 

4) Program Adrhirvf strati ve Review (PAR) is"a program initiated ' 
by the ChanceVlbr's^^ pff^^ to assist .col leges to comply with 
•* the widevVariefy .'oi^s rules and regulations to which 



they arBsSubject. (the intent of the review is not the 
impositiorrof sanctjo 
continuing procedure. 



imposition^of sanctions bu^ and assistance. PAR ^a 
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5) The Course -Activities Measure .Is an Ififormat Ion system uhder 
which the Chancellor 'S Office collects detailed Information 
. on courses and enrollments twice yearly. .Because of the 
difficulty of ^obtaining a 400 percent return, .this Infor-^ 

'niatlbh Is not used for its originally Intended purpose as a 
basis Tor, apportionment of state funds.- After processing, ' 
information is rgturned to tlie colleger where it may be used 
for Internal evaluatlbj^-^ e.g. , relative course productivity 

— and as a check againsj: adverse audits of apportioned ^ 
funds.. V - ■ ' , - 



Review If existing progi^ams in the ChancePllor' s Office focuses on ; ' 
occupational rather than nonoccupap'onal prpgrams becauset^ of federal 
ft requirements for evaluation apd the availability of federal funds to 
su'pport eval_u^ation activity. Current COPES activity represents a 
reduction in scope from plans of tkje early 1970^, but the inclusion 
of COPES, SAM ^ and PAR 'in a four-year project involving all colleges 
is cortsidered a new and impiortant integration "of evaluation ^activity 
by the Program Evaluation^office. The Chancellor's Office does not 
currently plan extending this evaluation activity ^o academic 
progrj^am^. ^ * , 



116 



( 



APPENDIX C 

\ PROGRm UNVERSITr AND COLLEGES ' 

Policies and procedures for program rev-ii^w in the California State 
Univd^ity and Colleges ^37^ set out*" in Annually updated ^ five-year 
planpin^documents. Historically, each such document has contained 
campus "Aoademic. Master Plan" projections of new programs for the 
succeeding Viv? years. The current document. Academic Program and 
- Resource PI aVing in ^e California State University and CollegesT 
duly* 1980, prt3jects programs for 1980-81 only, rather than for^the 
ne^t five years, because of the uncertainty of longer term funding 
in the aftermath of Proposition 1:3, Fi ve-year^rojections will be 
resumed 'In the next^annual plan in 19^.- ' - 

Overall ipesponsibilvty for program review"w1thin the Chaijcelfor's 
Office is with the Vice. Chancellor," Academic Affairs, 'and direct 
responsibility i5 with the Assistant Vice ChancellgrV who 'heads the 
office of Educational Programs and Resources (EP&R). Th'e.EP&R, . 
■ office consists of some. ten professiflpals who are organized into 
three closely related .sections: Planning, Progf4ms, and Resources. 
Approximately four percent of al^Chancellor'^ Office man- y^^^^ 
45 percent of the activity in EP&R is related to new program review 
existing, program review, or activities such as master planning and 
curricular studies^ in support of review activity. ^ 

. ■ ' ' ■ ' " ' ' * ■ ' . ■ ■ ■' . • ■ . . - ' ' ■ 

Extensive quantitative information is compiled in the Academic 
Planning Date Base by EP&R staff. This information system* ts ^ ^ 
. currently^ being modified to. permit direct campus use forxoiirse 
S€t>edalihg* and. other ^cal purposes. From this bale,, quantitative', 
comparative inform'at.ion relating ta program enrollments^ student/ 
faculty ratios, class size, and degrees is annually distributed to 



the campuses. for use in local reviews; of both new and existing 
programs. , " . 

Review of New Programs -> 
Governing board policies for review of new programs were establts^ied 
in 1963, and haVe remained relatively unchanged. In I963, the ■ 
Chancellor delegated approval of specified program options and - 
concentrations to the campus pr'esidehts. In 1979-80, a newly ; ; 
established Academic Planning and ProgT;am Review Committee^ chaired; 
by ttie Vi ce 'Chancel! ar,^ Academic Affairs, held its first meetings. ^ 
Consisting of faculty, campus and system a^iministrators, and ; ; 
Students, the Committee is said to have influenced the /I jfting of a ; 
new progragi mori tori urn imposed following Proposition -13. The 
Committee has also fconsulted on the revised requests, for campusp 
plans issued in 1980. 1 / 

New program review begins?. with the projection of prpposed programs 
^'by the campuse^ in their^annual fjve-year "Academic Master 'Plans." . 

These projections are reviewed by EP&R staff, and their recommen- 
,dati(yns,may be the bases for discussions with the campuses. The\ ^ 
•major purposes of review of . projected programs are: (1) access 

through planned program distribution;' (2) avoidance of unnecessary 

duplication; (3) determination of need for the progrS^m; and (4) 
..ppel imi nary determination of respwf^ce adequacy \ 

Greater attention than in the past i^ now given to campus master 
plan projections under , a new requirement that projected prograini be/ 
specifically related.to an explicit campus mission and supported by 
planning assumptions. Emphasis in the EP&R office may shift ^.the 
future from detailed review of individual programs already in cam|)us 
plans to closer examination df projected programs prior to inclusion 
in. those plans. ^ 



Governing ^oarct approval of new program projections in campus master 
plans authorizes the campuses'td^'pl^n-for. the^ and is requir- . . 

ed before a detailed proposal for implementation can be submitted* 
The goveriting board has delegated authority^ ^f or subsequent approvaf 
of detailed "proposal s^to th6 CHanceMor.The ChancelJorVs Office does 
nqf specify the procedures. by which new program proposals are devel- 
•oped, but does, of course,, specify th^content of these proposals* 
The proposals^for new programs are reviewed throughout the year by . i\ 
EftSB^stafi" through a Program Review Committee of six, analysts, each 
of whom prepares a written review — usual ly a^ sing! e page — of 
each proposal A resource analysis.is prepared by the Resources 
section of EP&R,, andi when appropriate, specialists in information 
systems and. in. health sciences sit with ^the corm(Ree* The commit-. 7 
. tee meets at least twice a month^ the* intent. beiiig^that action 
should tie J:aken on each new proposal withfn 20 working days of Us 
submission* it is estimated that about five y/eeks are required for 
review when thq proposal ^does not require .clarifi^aH(^n or addi- - , 
tional data. \ ..\ . 

Chajicellor' s Off ice and CPEC;|)^^l'Tcies effectively preyejot campuses 
from projecting programs in 5ome disciplines (e.g. ,. no additional » 
campuses are^to enter the fields of agriculture and engineering)* 
Informal and formal pi anniVigT discussions discourage campuses from 
.formally projecting other programs in campus plans* ; The . 
Chancellor's Office annually ^submits to the governing board 
approximately Sp^o 95 percent of the new programs that are j 
projected in campus plans, with substantial variation among the 
campuses in the^ endorsement, rate. After screening in the planning 
process, few programs are rejected when detailed proposals are 
submitted. After revfew, discussiioq, and consideration of " 
additional information, however, about five percent of the. proposals 
aire withdrawn, many to be resubmitted at a l^ater date. 



Criteria, for review of new programs are customary ones, but two 
aspects are relativfely. new: ' * 

1) New program proposals must. contain a completed "matrix" 

- chart on whicb^ both enrollment and faculty ar;e projected for 

the year of program initiation and for the third and fifth 
year thereafter, - 'the format requires projections and 
distrHfution of all campus enrollments and faculty, both 
V /with and without the proposed program, the purpose being to 
Identify redistribution of existing resources. The intent 
also is toincrease campus administrative and faculty 
awareness df the campuswide implications of implementation 
, of ^he^proposal. \ ■ 

2) Beginning with the 1980 plar^ing cycle, campus master plans 

V ; must justify, each new projected program in pterins of a sped-, 
fic^ campus mission and2 planning assumptions, ^n addition to 
. assisting in 'the determination of the appropriateness of the 

- pRogram for the campus, i such s^tements are intended, over , 

time, to 'clarify similarities and differences among cam- 
puses, both at the campuses and in the sj/stemwide office, ^ y 

The Chancellor's Office procedures do not distinguish between review 
of graduate^ and undergraducite programs other 'than in the criteria . 
for' each level 7- e.g., higher faculty qualifications are sought 
when a^master's program is proposed. The Chancellor's Office 
encourages, but does not require, that proposals for new graduate - ■ - 
programs bl related to current reviews of existing undergraduate 
programs. . - 



The Chancellor' s Office does not systematically monitor the imple- 

' - • . - . ■ . ■ - ■ ■ ■ ■ ' ^ . ■ 

meRtatlon of new programs, but does conduct an annual "catalog 



review." Campuses annuaTlpr report course changes that will appear 
in their catalogs, together with an accounting of courses added ^d 
subtracted. I4i.past reviews, EP&R staff have found a few instances, 
of offerings. that have not had. prior approval. . " 

EP&R staff perceive their thajor concerns iri^ new program review to be 
broader than those of tiie campuses i .e. , statewide manpower 
needs, regional program distribution, reasonably standard terminol- 
ogy. They also believe that system level review improves curricular 
decisions in some instances by raising questions to a more objective 
-perspective tlian may be available at the campuses. ' 

Review of E-xi sting Programs (Campus Reviews) 

Since 1971, the governing board has 'required campus review of exist- 
ing programs as part of the annua! ^ p1 anning process. Existing pro- 
grams are intended to be reviewed in a five-year cycle under broad 
pblicies that suggest examination of program goals and purposes, 
currici/far content, resources, past and current accomplishments, and 
the .number and placement of 'graduates. Each campus uses -local pro- 
cedures for review, and'these are summarized in the annual system- 
wide planning document. This document also contains each campus's 
schedule for review of. existing programs. EP&R staff monitor the 
scheduling, but have not as yet raised issues with^egard to it with 
the campuses.- ; ' / 

the campuses forward summaries of the findings of the reviews to the 
Chancellor' s Off iee, and these, are summarized, and aggregated by EP&R. 
staff for an annual report to the. governing board. Jo assure candid 
and effective review, at the campus level ,. the Chancellor' s Office 
does not request complete reportsr, nor does it take direct action on 
the summaries that it receives; the assumption is that campuses will 
take corrective action where this is required. EP&R does retain the 
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summaries for reference in reviewing new, program project ions i and 
proposal s. • ' . " 



early 1979, the Chancellor announced systemwide pol ici^e^; for the" 
'discontinuance of academic programs, specifying both substantive and 
procedural (fequirements: a proposal to* discontinue a program would 
-ordinarily be tijp result of a regiH^ or ad hoc review^ broad 
• consul fation^WuTd 45e required duri/ig the review; enrolled students 
' would be protected; and faculty advice" on the propos.ed discontin- 
- uance would be 'required. The pjolicies also required thai;^..c^^ 
v^d6veT^op^^^^w^ approval by the Chancellor. Jo date, 

-.^fght of the 19 campuses have submitted such procedures. 

Review of Existing Programs .(Cross-Campus Review) . 
Reviews of. existijfig. programs across campuses are initiated by the 
Chancellor's Office when the need is apparept* Formal procedures 
for initiating and conducting such reviews have liot .been estab- 
lished. It. appears that;in,the'past EP&R staff have given major 
direction to such reviews. • - . 



A review of programs in industrial -arts, industrial technology, and 
/Engineering technology was made ^ntk 1970, and a follW-up review in^ 
1977. The consul tative committee, appointed by the Chancell^or,- con- 
. sisted of two campus deans, a department chairman, a faculty member, 

and an EP&R staff member. As a^ result of this revidw, proposals.for 

• ."■ ■ ■ ■ & ' ^ 

programs leading to. mastery's degrees in industrial technology were . 

. t" . . ' ■ " , _ ■ . ■ ' 

rejected, and carfipuses were encourage^-to pur^ 

course of offering an option to MBA pppgram^."^ ' ;^ * 

A similar review of performing. arts curricula bas. been Completed in 
draft form, and -i's currently being reviewed b^ the camp t^ses and the 
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' facijlt^ : What is consicJere'd a more compi^ehensive review of 

■ teacher education is currently -in ]Drocess. 

Members' of the/Systemwide.^Faculty Senate have always sat as ob- 
, servers with the review committees/ and, more, recently ,^;members. of 

the revi ew committees h'aye. been selected, in consultation with the 
•\'5enate./ .. Z'^' J V:^. '." ' . . . 
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APPENDIX 0 - 

, , '■ PROGRAM REVIEW fN ff|';U^^ OF CALIFORNIA ''■ 

Program reyia^s Invthe University iot California have remained rela- 
tively urichangedv over the past ten years. . Both new and existing v 
program^ reviews take place in the' context of. earlier.s'ystemwide _ 
pi anriing documents ( University of California Academic Plan, 1974-783 
March 197.4; The University-wide Perspective, March 1975) and of the 
currently devel oping University Planning Statement 1980 (Draft , 
September 30, r9?6), .. • \^ - 



Resporisibility for program review is divided^both "horizontally" by 
Grganizational levels afidV-^WerticaTly" betWee^ adrr^ni strati ve and 
faculty bodies. / At ^ the sy stemwi de - ^admi n i strat i ve level , f res pon- 
sit)'l1ity for both new and existing' program review centers on the 
Academic i^laning and Program Review Board, (APPRB) with five members 
from the- Sy stemwi de Administraitiojfi, six facultyrmembersV^^^^^^^^ 
students ^: the Academic Vice Prjesident" chairs APPRB and transmits- 
its recdmmendatigns to the. President." At the systemwide faculty 
levej f . priniary responsibility- for program the . 

Coordinating Committee on Graduate Affairs (CCGA), a committee of 
the Academic Senate. Thd Senate has been delegated, reisponsibil ity 
for courses and curricula by the governing ^boar^ - 

Under the Academic Vice-President,' the off i^ of the. Assistant Vice 
President Academic Pl annina and Program Review (AVP-PPR) ^has 
direct adjninistrative responsibility for program reviei^acti vlties , 
for pTanrjing, and for staff assistance, to both APPRB and CGGA. 
AVP-PPR has ,a^; staff of some 12 professionals, of wKom..one member 
spendi approximately fuH-time on program revifew matters, the others* 
being involved/^s.'^workload requires. ' 



University and CP EC annual program inventories are used by AVP-PPR 
staff, and the University's information system -.- currently in the 
process of extensive reorganization provides them with data 
by campus Oh enrollments by degree, degrees conferred, and faculty 
FTE by department or degree program, ^ . ' . . 

'. • • . \ ■■ «■ ■ ' ' J -. * , ■ ■ 

AVP-P PR staff activity encompasses four types of program review: 
. (1) revi ew of new graduate prog^ams; ^ 2) of new undergraduate 
programs; (3) campus review of existing progran|S; and (4)' cross- 
campus reviews. AVP-PPR spends subtant^al ly more time with new 
graduate degree proposals than with either new undergraduate 
programs or campus reviews of existing, programs. Cross-campus 
reviews by discipl ine' are not routinely scheduled, although one or 
more, has been undertaken each year. 

New Program Review — Graduate Degree Programs 
Senate procedures for review of proposals for new graduate decree 
programs have been the responsibility of CCGA since 1961, and the 
general process has remained relatively constant over time. As , 
major change occurred in 1971 wheri APPRB was interposed between the 
faculty group and the President to bring a broader planning perspec- 
tive to recommendations. •■ * 

■ • ■ ' ^ ^: ■ . 

Each campus has its own procedures for initiating proposal s for new 
programs .and the^e remain substantially as described in Aca^iemic , 
Program Review in the University of California (October 1976) . Both 
the Systemwide Administration and CCGA specify the information to be 
provided in the proposals that Sre submitted for systemwide review. 
Each campus annually submits a J ist of the titles of .projected new 
programs to the Systemwide Administraiion as an update of its aca- 
. demi c |i||n.^^,/he « ists are reviewed by AVP-PPR, aggregated 
for a report, to CPEC, and later usejd by AVP-PPR in reviewing 



detailed proposals to determine if a proposed prograirr is part^ of th 
campus plan. Projected programs- receive more substantive, although 
'less formal, consideration by senior systemwide and campus staff 
during the several scheduled "visits" each year to each campus that 
are part of the University's rolling, three-yfear planning and i 
resource allocation process.- /' f 

•Canpus proposals for new graduate degree programs are tran^itted t 
both the faculty committee CCGA and the responsible adminis- 
trative office — AVP-PPR^ 

AVP-PPR prepares a prel iminary. analysis of t'he proposal for 
CCGA, raising such questions as student demand^ employment 
outlook, urinecessafy program duplication, and resources. Within 
^ the past year, AVP-PPR has also been providing CCGA with com- 
{iairative data on similar programs at other campuses. 

CCGA holds at least one hearing sometimes as many as four 
on each proposal, and elicits responses to questions raised by 
AVP-PPR and by its own review.. CCG/^ has primary responsibility 
at universitywide level for assessing program quality. Recent- 
ly, it has taken more interest than in the past in resource 
questions and in possible unnecessary. program duplication * 
because of uncer£atn fiscal and enrollment projections. Geh- 
^ erally, all proposals submitted to CCGA require additional or 
more cUrrent information, and most of those submitted are 
ultimately approved by CCGA. * * 

If CCGA approves, the proposal, AVP-PPR prepares, an ancilysis and ^ 
recommendations for a program 'review is.ubcommittee. of APPRB. APPRB 
generally relies on the subcommittee review and recommendation, but 
occasionally raises questions of its own, requesting additional 



D-4 



infonnation frpm the campuses. APPRB's rko'mmendations are sub- . 

'•^ . ■ ■. \ ° ■ . . 

mitted to the President. ' 

■ ■ ' ■ , ' \ ^ . ■. ■ • . 

fhe governing board must approve proposals involving degree titles 
that are new to a .campus (e.g. , MFA, M. Admins.)* 

If the President approves the proposal, a summary is prepared by 
AVP-PPR from information provided by the campus, and forwarded to 
CPEC for review and comment. On receipt of CPEC's concurrence, the 
Academic Vice President notifies the campus of final approval. 
Three 'types of new graduate degree proposals are accepted as infor)-,^. 
mation items by APPRB and do not require Presidential approval: {}) 
concurrent degree pr9grams which combine courses in two already 
■existing programs; (2) graduate certificate programs in which a 
certificate is issued for work completed in an existing program; and 
(3) master's programs within existing doctoral programs/ In gen- 
eral, unless new courses or additional resources are required, these 
three types, of proposal s. are reported to CPEC, not "submitted in 
advance for review and comment. ^ 

New Program Review — Undergraduate Degree Programs 
Historically, the Systemwide Administration' has not reviewed campus 
proposals for new undergraduate degree programs unless they involved 
a new degree title requiring governing board, approval. Current 
procedures were established in 1?75 to facilitate CPEC's then new .. 
legislative mandate teleview al 1 new programs in the three public 
segments. ■ .-.^if 



Each campus uses lQfcp|p'"ocedures to develop proposals. The 
information to be pEoiided^i the proposals, specified by the 
Systemwide Admi nist^ti on, refl ects agreements with CPEC, and 
information requifi^erits differ based on foUr catagories of 



undfeirg.raduate programs : (1 ) group and f i el d majors whi ch combine 
courses from existing programs; (2) professional programs; (3) 
programs with' degree titles new to t^^ and (4) all other 

programs. ^_./ . 

In general, if programs require new courses or new (or reallocated ) 
resources^ the proposal is submitted to CPEC for review and com- 
ment. . OtherWis'e, new undergraduate programs are only reported. 
Campuses are required to submit all proposals to: AVPrPPR, however,, 
along with a statemen^*;pf needs and a completed CP£C ques-; 
ti.onnaire; the decision on wifether CPEC review is required ,is made 
by AVP-PPft.' I nf onnat ion requirements dfff^r^^^^^a^^ types of ,^;^ 

programs — e.g., a proposal for a new professional program requires 
evidence. of. discussion with representatives of nearby State 
University campuses if the propdsaJ parallels existing programs at 
any of them. ; / . 

Proposals for new undergraduate programs require the approval of the 
Academic Vice President, but this approyal routinely given when 
proposals comply with systemwide requirements for. reporting programs 

to CPEC. . , : 

As with graduate programs, a list of projected undergraduate pro- 
grams is annually submitted to AVP-PPR by the campuses as part of 
their planning processes and AVP-PPR consolidates the campus lists 
in. an annual report to CPEC. \ . 

.... ' / *■ ^ :* 

^ Review of Existing Programs — Campus Review 
Review of existing gradu*!;^ and undergraduate programs at the campus 
lejfel is the rissponsibil ity of the locaj^jdiyasion of the Am^^^^ 

, Senate. These reviews are conduct to satisfy the faculty and / 
administration that standards of quality are^being maintained and to 



provide specific constructive ady^ice about the strengtlis ^d weak- 
nesses to the unit under review and to others "responsible for the 
program. * 

Each campus uses; its own procedures for selection of programs to be 
reviewed and for the detailed ccfntent of reviews. Campus reviews 
are described at length in Academic Program Review in the University 
of California (October 1976) ,9nd the descriptions remain substan- 
tially accurate. Although the '1976 report, is addressed primarily to , 
campus faculty and administrators,* one recommendation si^ests the 
desirability of comparable information across campuses to improve 
the consistency of review reports and to incre*ase.;their utility at 
each campus and ^^ong campuses. / V 

Results, of campus reviews are reported anhually to AVP-PRR in sum- 
mary foEm, and these are consolidated by AVP-PPR in i report to 
CPEC. . AVP-PPR monitors campus reviews to assure accurate reports to" 
CPEC, but not for the purpose of detemiing campus compliance jyith 
campus review schedules or policies. :- ' ' 

J I ri -September^^^^ the President issued systemwide policies requir- 
ing eadh campus to; establish written procedures for the transfer, 
consolidation, .disestablishment,; and discontinuance of academic ^ 
programs and units.. These [jolicies note that such procedures should 
norma lly . require a regular or acl hoc review of the program prior to 
a. deci sion to di scontinue it. yMost campuses have submitted pro- ■ 
cedures, but AVP-l*PR-has ndt yet reviewed them for compliance with 
Presidential pol icies. The policies, in addition -to asking for v 
written procedures, require consultation with faculty and studeW^^ 
peer review of program quality, and, whenever possible, review by \ 
scholars from, outside the University.' Campus procedures are also to 

■ protect enrolled students and to make "appropriate accommodations". 
for a-^fected facCTlty and staff . • .... ^ ' . .^li:. >[ ' 



Review of Existing Programs " Cross«Campus Reviews 
In the early 1979'*s APPR6 initiated reviews, of ^eleQted program 
areas on a systemwide basis where pi annift^ problems raised clear-cut 
systemwide issues —e.g., possible unnecessary program duplica- 
tion, shortages or excesses bf Ph.D. 's, etc. Cro^s-campus reviews 
under APPRB au§pices have been conducted of programs in administra- 
tion, marijrie. sciences, education, and. classics. Engineering pro- 
grams are currenftly under review. 

[Reviews under ASPPRB auspices were tonducted by ad hoc committees 

iappointecl bj^.the President in consultation with the Academic Senate, 

*-■■,' ■ ■ • ' " 

and these committees were staffed, by AVP-PPR. , Committee .recommen- 
dations were made to APPRB, which sought comments f rorri conclerned ^ 
campus chancellors. Senate -committees, and others. APPRB' s recom- - 
mendations were then made to the President. . s> * 

In September 1980,. the President approved new procedures that 
require joint sponsorship of cross-campus reviews by the Systenwide 
Administration and the Academic Senate./ Systemwide administrator^ 
view these procedures as a significant step forward in shared 
governance. Responsibility for initiating cross-campus reviews. is . 
shifted from the administration (i .e.:,LAPPRB) to^^^^^ 
composed of the chairs of APPRB and three major Aca'demic Senate 
CjamrBrittees. This committee can arrangi' for reviews on its own 
i hf tiatWevQ^^ act on requests from the President, the Academic 
. Council/(;!^^^^ of an executive committee of the Senate) , the, 
Council: of Chahce'tl^rs, or an individual campus chaiicel lor. 

Cross-campus reviews will continue to hav6 their primary focus on 
the maintenance of h^tg^ academic quality just as do local campits 
reviews. . Cross-campus reviews by discipline are not routinely 
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scheduled, .however, and will be initiated whenever specific concerns 
go beyond the purview 'of . any one campus. The procedures note that 
such concern might arise when a campus proposes a neyy graduate 
program that already exists* on one or more other University cam- \ 
puses, systemwide administrators ^tress the substantial co^t and" 
effort expended in conducting cross-campus reviews. 
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VEXHIBIT E 
REVIEWERS; 



The program review descriptions '(Appendicefs A through D) benefited 
from review by the organizational representatives for the study: 

•Ernest Berg, Carlton Bovell, Norman Charles, and Anthony Moye. 
We, not. they, are respohsible for any errors, however. We are 
grateful to them- and td' others who took time to . respond to our<.. 
request for comment on "tentative! recommendations/" Despite ' 

^ substsmtial difference in^format, tJiis 'final report profits from 
the valuable. suggestions of these reviewers. They are: 

Kay J." Andersen, 'Executive; Director " 
Western Assoclatiori^of Schools and Colleges ' ' 

Sandra 0.. Archibald^ Student ' , . - 7 

University of (^1 if or ni a, Davis 

^Frederick E. Balderston, Professor ' ^ ' 

Uniy^sity of California, Berkeley 



Arnold Binder, Professor 
University of California, Irvine 

Thomas B. Day , President 
Sah Diego State University 

Tyra Duncan-Hall , Professor 
San Franpsico Community College 

Yvette M- Fallandy, Professor 
Sondmaj State Uniyer stiy 



Thomas W- Fryer, Jr/, Chancellor , 
foothill-De Anza Community .College District \ 

Harold E. Geiogue, Budget Analyst 

Califbrnia State Legislative Budget Cdnmiftee 



Mt.; San Jacinto Community College , 

Jack rKeTinedy, gudget Analyst . > \ 
CaliTornia State Department of Finance 

:Gerald Kis-sler, Assistant Director of Planning ^ 
University of California, Los Angeles 




Milo P. Johnson," Superintendent 
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Robert D. Kully;*'- Professor . . 
California State Univers'Tty. Lo.s Angeles 

■ . • * 

Eugene C. Lee, Professor , J' , 
. University of California,, Berkeley 

Donald A. MacPhee, Vice President - 
. California: State University, Dominguez ttills^^^-^^^^^^^^ ^^^ 
- . ■ ' ' • -""^ .. • ' 

Allen. 6. Marr, Dean, Graduate" S^^^^ 
University^of California, Davis 

Chester O. McCorkle, Jr., Professor . 
University of California, Davis ■'■ ■ ^ 

Ellis E. McCune,. President ' ' - 

California State University, Hazard 

James. H. Meyer; Chancellor 

University of California, Davis . , ' 

• '/ ■ ' ■ ■ ■ -^^ ■'■ " '" \ ■ ' . . ' . 

Morgan Odell, Executive Director 

Association, of IndepeV^^ California College and Universities 

Garland P. Peed, Chancellor . v ' ^. 

San "Diego Cofnmunity^ College Di^strict . ^ * 

Sam Schauermah, Vice President- Ihstrtfctiqn , * 

ll^Cami no College. '-^''^ ;^ ^ ^ 

Glenn P. Srath, Chancellor 
San Mateo Ciounty. Community College District 

Herbert M. Sussman, Chancellor ,: ■ ; \ 

San Francisco Cdimnunity College District . y / 

; ' ■ . . . ... . ^ • ■ 

Robert E. Swenson, Executive. Director ^ h 
.Accrediting Commission for Conmiunity* and Junior Colleges, r 

■* " '•* \, 

At the .Center fo^* Studies in Higher Education, University of Cali- 
fornia, Berkeley, Martin Trow, Steve .Wei ner, and Janet Ruyle afforded 
us an opportunity, to discuss .^he. study with state, admintstrative, 
and faculty leaders at two /seminars. 

• ■ ■ i . ■■■'.■■.7-' ■ ' ' ^ " 

At the Office of the Chancellor, Caliifornta State University and 
Col leges., Alex Sherriffs and Yvette Fa:?^Un^y afforded us an oppor-. 
. tunity to meet with systemwide administrative and faculty senate 
committees. .. / . ' ; 



